Sep 18 13:12:16 devstack cinder-volume[75031]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 13:12:16 devstack cinder-volume[75031]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 13:12:16 devstack cinder-volume[75031]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 13:12:18 devstack cinder-volume[75031]: INFO dbcounter [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Registered counter for database cinder
Sep 18 13:12:18 devstack cinder-volume[75031]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 13:12:18 devstack cinder-volume[75031]: DEBUG dbcounter [-] [75031] Writer thread running {{(pid=75031) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 13:12:18 devstack cinder-volume[75031]: INFO cinder.rpc [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 18 13:12:18 devstack cinder-volume[75031]: INFO cinder.rpc [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 18 13:12:18 devstack cinder-volume[75031]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 13:12:18 devstack cinder-volume[75031]: INFO cinder.volume.manager [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Determined volume DB was empty at startup.
Sep 18 13:12:18 devstack cinder-volume[75031]: DEBUG cinder.volume.manager [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75031) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 18 13:12:18 devstack cinder-volume[75031]: INFO cinder.volume.manager [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 18 13:12:18 devstack cinder-volume[75031]: WARNING stevedore.named [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 13:12:19 devstack cinder-volume[75031]: WARNING castellan.key_manager [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 13:12:19 devstack cinder-volume[75031]: WARNING cinder.keymgr.conf_key_mgr [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 13:12:19 devstack cinder-volume[75031]: DEBUG cinder.volume.drivers.lvm [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75031) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 18 13:12:19 devstack cinder-volume[75031]: DEBUG oslo_concurrency.processutils [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_concurrency.processutils [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] CMD "cinder-rtstool verify" returned: 0 in 1.067s {{(pid=75031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 13:12:20 devstack cinder-volume[75031]: INFO cinder.rpc [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 18 13:12:20 devstack cinder-volume[75031]: INFO cinder.rpc [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 18 13:12:20 devstack cinder-volume[75031]: WARNING stevedore.named [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 13:12:20 devstack cinder-volume[75031]: WARNING castellan.key_manager [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 13:12:20 devstack cinder-volume[75031]: INFO cinder.volume.manager [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 13:12:20 devstack cinder-volume[75031]: INFO oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Starting 1 workers
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Started child 75178 {{(pid=75031) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Full set of CONF: {{(pid=75031) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] ******************************************************************************** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Configuration options gathered from: {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] ================================================================================ {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] allow_availability_zone_fallback = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] allow_compression_on_image_upload = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] allowed_direct_url_schemes     = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] api_rate_limit                 = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] auth_strategy                  = keystone {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] az_cache_duration              = 3600 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_availability_zone      = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_host                   = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_name                   = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_stats_polling_interval = 60 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backup_api_class               = cinder.backup.api.API {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backup_name_template           = backup-%s {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backup_use_same_host           = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backup_use_temp_snapshot       = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] chap_password                  = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] chap_username                  =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cinder_internal_tenant_project_id = ccb908c76e73467ea811133875ae8b6b {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cinder_internal_tenant_user_id = 145e3a183e0c4d5ab10fb7a2bfe04b86 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cloned_volume_same_az          = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cluster                        = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] compression_format             = gzip {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] compute_api_class              = cinder.compute.nova.API {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] config_dir                     = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:20 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] config_source                  = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] control_exchange               = openstack {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] debug                          = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] default_availability_zone      = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] default_group_type             = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] default_volume_type            = lvmdriver-1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] driver_client_cert             = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] driver_client_cert_key         = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] driver_data_namespace          = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] driver_ssl_cert_path           = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] driver_ssl_cert_verify         = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] driver_use_ssl                 = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] enable_force_upload            = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] enable_new_services            = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] enable_unsupported_driver      = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] enforce_multipath_for_image_xfer = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] filter_function                = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_api_insecure            = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_api_servers             = ['http://192.168.122.113/image'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_api_ssl_compression     = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_ca_certificates_file    = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_catalog_info            = image:glance:publicURL {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_certfile                = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_keyfile                 = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_num_retries             = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance_request_timeout         = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] goodness_function              = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] graceful_shutdown_timeout      = 5 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] group_api_class                = cinder.group.api.API {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] host                           = devstack {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75178]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_compress_on_upload       = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_conversion_address_space_limit = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_conversion_cpu_limit     = 60 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_conversion_disable       = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_upload_use_cinder_backend = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_upload_use_internal_tenant = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_volume_cache_enabled     = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_volume_cache_max_count   = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] image_volume_cache_max_size_gb = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] init_host_max_objects_retrieval = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] instance_format                = [instance: %(uuid)s]  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] iscsi_iotype                   = fileio {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] iscsi_target_flags             =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] iscsi_write_cache              = on {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] iser_helper                    = tgtadm {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] iser_ip_address                = 192.168.122.113 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] iser_port                      = 3260 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] log_color                      = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] log_config_append              = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] log_dir                        = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] log_file                       = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] log_options                    = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] log_rotate_interval            = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] log_rotate_interval_type       = days {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] log_rotation_type              = none {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] max_age                        = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] max_logfile_count              = 30 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] max_logfile_size_mb            = 200 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] max_over_subscription_ratio    = 20.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] message_reap_interval          = 86400 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] message_ttl                    = 2592000 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] migration_create_volume_timeout_secs = 300 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] monkey_patch                   = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] monkey_patch_modules           = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] my_ip                          = 192.168.122.113 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] no_snapshot_gb_quota           = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] num_iser_scan_tries            = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] num_shell_tries                = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] num_volume_device_scan_tries   = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] nvmeof_conn_info_version       = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] nvmet_ns_id                    = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] nvmet_port_id                  = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] osapi_max_limit                = 1000 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] osapi_volume_ext_list          = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] osapi_volume_listen_port       = 8776 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] osapi_volume_use_ssl           = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] osapi_volume_workers           = 2 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] per_volume_size_limit          = -1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] periodic_fuzzy_delay           = 60 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] periodic_interval              = 60 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] public_endpoint                = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] publish_errors                 = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] quota_backup_gigabytes         = 1000 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] quota_backups                  = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] quota_gigabytes                = 1000 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] quota_groups                   = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] quota_snapshots                = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] quota_volumes                  = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] rate_limit_burst               = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] rate_limit_except_level        = CRITICAL {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] rate_limit_interval            = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] reinit_driver_count            = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] replication_device             = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] report_discard_supported       = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] report_interval                = 120 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] reservation_clean_interval     = 86400 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] reservation_expire             = 86400 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] reserved_image_namespaces      = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] reserved_percentage            = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] rpc_response_timeout           = 120 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] run_external_periodic_tasks    = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] scst_target_driver             = iscsi {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] scst_target_iqn_name           = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_down_time              = 720 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] shell_completion               = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] snapshot_name_template         = snapshot-%s {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] snapshot_same_host             = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] split_loggers                  = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] state_path                     = /opt/stack/data/cinder {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] storage_availability_zone      = nova {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] storage_protocol               = iSCSI {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] syslog_log_facility            = LOG_USER {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] target_helper                  = lioadm {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] target_ip_address              = 192.168.122.113 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] target_port                    = 3260 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] target_protocol                = iscsi {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] target_secondary_ip_addresses  = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] trace_flags                    = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] transport_url                  = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] until_refresh                  = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] use_chap_auth                  = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] use_default_quota_class        = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] use_journal                    = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] use_json                       = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] use_multipath_for_image_xfer   = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] use_stderr                     = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] use_syslog                     = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] verify_glance_signatures       = enabled {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_api_class               = cinder.volume.api.API {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_backend_name            = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_clear                   = zero {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_clear_ionice            = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_clear_size              = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_copy_bps_limit          = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_dd_blocksize            = 1M {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_name_template           = volume-%s {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_service_inithost_offload = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volume_usage_audit_period      = month {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] watch_log_file                 = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] zoning_mode                    = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_concurrency.disable_process_locking = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.admin_password = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.admin_token = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.admin_user  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.auth_port   = 35357 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.auth_protocol = https {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.auth_section = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.auth_type   = password {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.auth_uri    = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.auth_version = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.cache       = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.certfile    = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.delay_auth_decision = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.http_connect_timeout = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.identity_uri = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.include_service_catalog = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.insecure    = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.interface   = public {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.keyfile     = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_password =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcache_username =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.region_name = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.service_token_roles_required = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.service_type = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.token_cache_time = 300 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.backend                  = dogpile.cache.null {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.backend_argument         = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.backend_expiration_time  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.config_prefix            = cache.oslo {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.dead_timeout             = 60.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.debug_cache_backend      = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.enable_retry_client      = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.enable_socket_keepalive  = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.enabled                  = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.enforce_fips_mode        = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.expiration_time          = 600 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.hashclient_retry_attempts = 2 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_dead_retry      = 300 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_password        = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_pool_maxsize    = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_sasl_enabled    = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.memcache_username        = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.proxies                  = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.redis_db                 = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.redis_password           = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.redis_sentinel_service_name = mymaster {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.redis_server             = localhost:6379 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.redis_socket_timeout     = 1.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.redis_username           = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.retry_attempts           = 2 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.retry_delay              = 0.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.socket_keepalive_count   = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.socket_keepalive_idle    = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.socket_keepalive_interval = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.tls_allowed_ciphers      = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.tls_cafile               = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.tls_certfile             = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.tls_enabled              = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cache.tls_keyfile              = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] coordination.backend_url       = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.asyncio_connection    = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.asyncio_slave_connection = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.backend               = sqlalchemy {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.connection            = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.connection_debug      = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.connection_parameters =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.connection_recycle_time = 3600 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75178]: INFO cinder.volume.manager [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.connection_trace      = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.db_inc_retry_interval = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.db_max_retries        = 20 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.db_max_retry_interval = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.db_retry_interval     = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.max_overflow          = 50 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.max_pool_size         = 5 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.max_retries           = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.mysql_wsrep_sync_wait = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.pool_timeout          = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.retry_interval        = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.slave_connection      = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.sqlite_synchronous    = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] database.use_db_reconnect      = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.connection_string     = messaging:// {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.enabled               = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.es_doc_type           = notification {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.es_scroll_size        = 10000 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.es_scroll_time        = 2m {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.filter_error_trace    = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.hmac_keys             = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.sentinel_service_name = mymaster {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.socket_timeout        = 0.1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.trace_requests        = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler.trace_sqlalchemy      = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler_jaeger.process_tags   = {} {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler_jaeger.service_name_prefix = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] profiler_otlp.service_name_prefix = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.enforce_new_defaults = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: WARNING oslo_config.cfg [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.enforce_scope      = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.policy_default_rule = default {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.policy_file        = policy.yaml {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] privsep_osbrick.group          = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] privsep_osbrick.helper_command = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] privsep_osbrick.user           = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cinder_sys_admin.group         = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cinder_sys_admin.helper_command = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] cinder_sys_admin.user          = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.auth_section      = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.auth_type         = password {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.certfile          = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.collect_timing    = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.insecure          = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.keyfile           = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.send_service_user_token = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.split_loggers     = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] service_user.timeout           = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance.auth_section            = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance.auth_type               = password {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance.certfile                = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance.collect_timing          = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance.insecure                = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance.keyfile                 = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance.split_loggers           = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] glance.timeout                 = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.backend_availability_zone = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.chap_password = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.chap_username =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.driver_client_cert = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.driver_client_cert_key = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.driver_data_namespace = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.driver_use_ssl = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.enable_unsupported_driver = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.extra_capabilities = {} {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.filter_function = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.goodness_function = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.iscsi_target_flags =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.iscsi_write_cache = on {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.iser_helper   = tgtadm {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.iser_ip_address = 192.168.122.113 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.iser_port     = 3260 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.lvm_share_target = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.lvm_type      = auto {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.num_shell_tries = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.nvmet_port_id = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.replication_device = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.report_discard_supported = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.reserved_percentage = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.scst_target_driver = iscsi {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.scst_target_iqn_name = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.storage_protocol = iSCSI {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.target_helper = tgtadm {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.target_ip_address = 192.168.122.113 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.target_port   = 3260 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.target_protocol = iscsi {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.trace_flags   = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.unique_fqdn_network = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.use_chap_auth = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volume_backend_name = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volume_clear  = zero {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volume_clear_ionice = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volume_clear_size = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_reports.file_event_handler = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_reports.log_dir           = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.backend_availability_zone = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.backend_host       = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.chap_password      = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.chap_username      = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.driver_client_cert = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.driver_data_namespace = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.extra_capabilities = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.filter_function    = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.goodness_function  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.191s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.iser_helper        = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.iser_ip_address    = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.iser_port          = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.iser_target_prefix = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.lvm_share_target   = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.lvm_type           = auto {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.num_shell_tries    = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.replication_device = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.report_discard_supported = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.reserved_percentage = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.scst_target_driver = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.storage_protocol   = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.target_helper      = lioadm {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.target_ip_address  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.target_port        = 3260 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.trace_flags        = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.use_chap_auth      = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volume_clear       = zero {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volume_clear_size  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] lvmdriver-1.volumes_dir        = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.ssl      = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_notifications.driver = [] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_notifications.retry = -1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] oslo_messaging_notifications.transport_url = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] key_manager.fixed_key          = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.barbican_api_version  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.barbican_endpoint     = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.barbican_endpoint_type = public {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.barbican_region_name  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.cafile                = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.certfile              = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.collect_timing        = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.insecure              = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.keyfile               = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.number_of_retries     = 60 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.retry_delay           = 1 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.send_service_user_token = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.split_loggers         = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.timeout               = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.verify_ssl            = True {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican.verify_ssl_path       = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican_service_user.auth_section = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican_service_user.auth_type = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican_service_user.cafile   = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican_service_user.certfile = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican_service_user.collect_timing = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican_service_user.insecure = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican_service_user.keyfile  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican_service_user.split_loggers = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] barbican_service_user.timeout  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.approle_role_id          = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.approle_secret_id        = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.kv_mountpoint            = secret {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.kv_path                  = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.kv_version               = 2 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.namespace                = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.root_token_id            = **** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.ssl_ca_crt_file          = None {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.timeout                  = 60.0 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.use_ssl                  = False {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:12:21 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] ******************************************************************************** {{(pid=75031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 18 13:12:21 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.171s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:21 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:21 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:21 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:22 devstack sudo[75246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 18 13:12:22 devstack sudo[75246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:23 devstack sudo[75246]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:23 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 1.983s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:23 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:24 devstack sudo[75354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:12:24 devstack sudo[75354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:25 devstack sudo[75354]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:26 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.049s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:26 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:12:26 devstack cinder-volume[75178]: INFO cinder.brick.local_dev.lvm [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 18 13:12:26 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:26 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.091s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:26 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:26 devstack sudo[75457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:12:26 devstack sudo[75457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:28 devstack sudo[75457]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:28 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.092s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:28 devstack cinder-volume[75178]: DEBUG cinder.brick.local_dev.lvm [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75178) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 18 13:12:28 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:28 devstack sudo[75550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:12:28 devstack sudo[75550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:30 devstack cinder-volume[75031]: DEBUG dbcounter [-] [75031] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75031) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:12:31 devstack sudo[75550]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:31 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.658s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:31 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:32 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:32 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:32 devstack sudo[75732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:12:32 devstack sudo[75732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:34 devstack sudo[75732]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:34 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.125s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:34 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:34 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.078s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:34 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:34 devstack sudo[75769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 18 13:12:34 devstack sudo[75769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:36 devstack sudo[75769]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:36 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.469s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:36 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:37 devstack sudo[75824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:12:37 devstack sudo[75824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:39 devstack sudo[75824]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:39 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.103s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:39 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:40 devstack sudo[75862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:12:40 devstack sudo[75862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:43 devstack sudo[75862]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:43 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.830s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:43 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:43 devstack sudo[75900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:12:43 devstack sudo[75900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:46 devstack sudo[75900]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:46 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.552s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:46 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:46 devstack sudo[75906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:12:46 devstack sudo[75906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:48 devstack sudo[75906]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:48 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.163s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:48 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:48 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.127s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:48 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:48 devstack sudo[75933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:12:48 devstack sudo[75933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:50 devstack sudo[75933]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:50 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.089s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:50 devstack cinder-volume[75178]: INFO cinder.volume.drivers.lvm [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 18 13:12:50 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:50 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.079s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:50 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:51 devstack sudo[76029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:12:51 devstack sudo[76029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:52 devstack sudo[76029]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:52 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.027s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:52 devstack cinder-volume[75178]: DEBUG cinder.volume.drivers.lvm [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Updating volume stats {{(pid=75178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 13:12:53 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:53 devstack sudo[76175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:12:53 devstack sudo[76175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:55 devstack sudo[76175]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:55 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.148s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:55 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:55 devstack sudo[76179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:12:55 devstack sudo[76179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:57 devstack sudo[76179]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:57 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.052s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:57 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:57 devstack sudo[76182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:12:57 devstack sudo[76182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:12:59 devstack sudo[76182]: pam_unix(sudo:session): session closed for user root
Sep 18 13:12:59 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.196s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:12:59 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:12:59 devstack sudo[76188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:12:59 devstack sudo[76188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:13:01 devstack sudo[76188]: pam_unix(sudo:session): session closed for user root
Sep 18 13:13:01 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.075s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:13:01 devstack cinder-volume[75178]: INFO cinder.volume.driver [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Driver hasn't implemented _init_vendor_properties()
Sep 18 13:13:01 devstack cinder-volume[75178]: DEBUG cinder.volume.driver [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75178) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 18 13:13:01 devstack cinder-volume[75178]: DEBUG oslo_db.sqlalchemy.engines [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 13:13:01 devstack cinder-volume[75178]: DEBUG dbcounter [-] [75178] Writer thread running {{(pid=75178) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 13:13:01 devstack cinder-volume[75178]: DEBUG cinder.db.sqlalchemy.api [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Building query based on filter {{(pid=75178) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 18 13:13:01 devstack cinder-volume[75178]: DEBUG cinder.image.image_utils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75178) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 18 13:13:02 devstack cinder-volume[75178]: INFO cinder.keymgr.migration [None req-5363199e-f761-4f37-af3e-8f06bc40bb50 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 18 13:13:02 devstack cinder-volume[75178]: DEBUG cinder.volume.drivers.lvm [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Updating volume stats {{(pid=75178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 13:13:02 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:13:02 devstack sudo[76193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:13:02 devstack sudo[76193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:13:04 devstack sudo[76193]: pam_unix(sudo:session): session closed for user root
Sep 18 13:13:04 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.012s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:13:04 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:13:04 devstack sudo[76289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:13:04 devstack sudo[76289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:13:06 devstack sudo[76289]: pam_unix(sudo:session): session closed for user root
Sep 18 13:13:06 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.045s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:13:06 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:13:06 devstack sudo[76340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:13:06 devstack sudo[76340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:13:08 devstack sudo[76340]: pam_unix(sudo:session): session closed for user root
Sep 18 13:13:08 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.242s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:13:08 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:13:08 devstack sudo[76344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:13:08 devstack sudo[76344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:13:10 devstack sudo[76344]: pam_unix(sudo:session): session closed for user root
Sep 18 13:13:10 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.099s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:13:10 devstack cinder-volume[75178]: DEBUG cinder.manager [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Notifying Schedulers of capabilities ... {{(pid=75178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:13:10 devstack cinder-volume[75178]: INFO cinder.volume.manager [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Driver initialization completed successfully.
Sep 18 13:13:10 devstack cinder-volume[75178]: INFO cinder.manager [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Initiating service 2 cleanup
Sep 18 13:13:10 devstack cinder-volume[75178]: INFO cinder.manager [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Service 2 cleanup completed.
Sep 18 13:13:10 devstack cinder-volume[75178]: DEBUG cinder.service [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Creating RPC server for service cinder-volume {{(pid=75178) start /opt/stack/cinder/cinder/service.py:239}}
Sep 18 13:13:10 devstack cinder-volume[75178]: DEBUG cinder.service [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75178) start /opt/stack/cinder/cinder/service.py:245}}
Sep 18 13:13:10 devstack cinder-volume[75178]: INFO cinder.volume.manager [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 18 13:13:10 devstack cinder-volume[75178]: DEBUG cinder.volume.drivers.lvm [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Updating volume stats {{(pid=75178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 13:13:10 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:13:11 devstack sudo[76347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:13:11 devstack sudo[76347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:13:13 devstack sudo[76347]: pam_unix(sudo:session): session closed for user root
Sep 18 13:13:13 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.082s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:13:13 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:13:13 devstack sudo[76355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:13:13 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:13:15 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root
Sep 18 13:13:15 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.994s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:13:15 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:13:15 devstack sudo[76363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:13:15 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:13:17 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root
Sep 18 13:13:17 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.066s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:13:17 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:13:17 devstack sudo[76366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:13:17 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:13:18 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root
Sep 18 13:13:18 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.744s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:13:19 devstack cinder-volume[75178]: DEBUG dbcounter [-] [75178] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75178) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:13:19 devstack cinder-volume[75178]: INFO cinder.volume.manager [None req-1cc0aa61-c5a4-4bdc-893c-ead6a6c4e424 None None] Driver post RPC initialization completed successfully.
Sep 18 13:13:29 devstack cinder-volume[75178]: DEBUG dbcounter [-] [75178] Writing DB stats cinder:SELECT=4 {{(pid=75178) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:14:18 devstack cinder-volume[75178]: DEBUG oslo_service.periodic_task [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75178) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:14:18 devstack cinder-volume[75178]: DEBUG cinder.volume.drivers.lvm [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Updating volume stats {{(pid=75178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 13:14:18 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:14:18 devstack sudo[77715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:14:18 devstack sudo[77715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:14:20 devstack sudo[77715]: pam_unix(sudo:session): session closed for user root
Sep 18 13:14:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.891s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:14:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:14:20 devstack sudo[77726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:14:20 devstack sudo[77726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:14:21 devstack sudo[77726]: pam_unix(sudo:session): session closed for user root
Sep 18 13:14:21 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.848s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:14:21 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:14:22 devstack sudo[77729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:14:22 devstack sudo[77729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:14:23 devstack sudo[77729]: pam_unix(sudo:session): session closed for user root
Sep 18 13:14:23 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.890s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:14:23 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:14:24 devstack sudo[77734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:14:24 devstack sudo[77734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:14:25 devstack sudo[77734]: pam_unix(sudo:session): session closed for user root
Sep 18 13:14:25 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.024s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:14:25 devstack cinder-volume[75178]: DEBUG cinder.manager [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Notifying Schedulers of capabilities ... {{(pid=75178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:15:18 devstack cinder-volume[75178]: DEBUG oslo_service.periodic_task [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75178) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:15:18 devstack cinder-volume[75178]: DEBUG cinder.volume.drivers.lvm [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Updating volume stats {{(pid=75178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 13:15:18 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:15:18 devstack sudo[78274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:15:18 devstack sudo[78274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:15:20 devstack sudo[78274]: pam_unix(sudo:session): session closed for user root
Sep 18 13:15:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.965s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:15:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:15:20 devstack sudo[78346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:15:20 devstack sudo[78346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:15:22 devstack sudo[78346]: pam_unix(sudo:session): session closed for user root
Sep 18 13:15:22 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.944s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:15:22 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:15:22 devstack sudo[78459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:15:22 devstack sudo[78459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:15:24 devstack sudo[78459]: pam_unix(sudo:session): session closed for user root
Sep 18 13:15:24 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.980s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:15:24 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:15:24 devstack sudo[78465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:15:24 devstack sudo[78465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:15:26 devstack sudo[78465]: pam_unix(sudo:session): session closed for user root
Sep 18 13:15:26 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.010s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:15:26 devstack cinder-volume[75178]: DEBUG cinder.manager [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Notifying Schedulers of capabilities ... {{(pid=75178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:15:29 devstack cinder-volume[75178]: DEBUG dbcounter [-] [75178] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75178) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:16:18 devstack cinder-volume[75178]: DEBUG oslo_service.periodic_task [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75178) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:16:18 devstack cinder-volume[75178]: DEBUG cinder.volume.drivers.lvm [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Updating volume stats {{(pid=75178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 13:16:18 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:16:18 devstack sudo[81246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:16:18 devstack sudo[81246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:16:20 devstack sudo[81246]: pam_unix(sudo:session): session closed for user root
Sep 18 13:16:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.992s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:16:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:16:20 devstack sudo[81252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:16:20 devstack sudo[81252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:16:22 devstack sudo[81252]: pam_unix(sudo:session): session closed for user root
Sep 18 13:16:22 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.972s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:16:22 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:16:22 devstack sudo[81255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:16:22 devstack sudo[81255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:16:23 devstack sudo[81255]: pam_unix(sudo:session): session closed for user root
Sep 18 13:16:23 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.758s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:16:24 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:16:24 devstack sudo[81258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:16:24 devstack sudo[81258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:16:25 devstack sudo[81258]: pam_unix(sudo:session): session closed for user root
Sep 18 13:16:25 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.852s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:16:25 devstack cinder-volume[75178]: DEBUG cinder.manager [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Notifying Schedulers of capabilities ... {{(pid=75178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:17:18 devstack cinder-volume[75178]: DEBUG oslo_service.periodic_task [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75178) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:17:18 devstack cinder-volume[75178]: DEBUG cinder.volume.drivers.lvm [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Updating volume stats {{(pid=75178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 13:17:18 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:17:18 devstack sudo[81476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:17:18 devstack sudo[81476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:17:20 devstack sudo[81476]: pam_unix(sudo:session): session closed for user root
Sep 18 13:17:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.007s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:17:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:17:20 devstack sudo[81513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:17:20 devstack sudo[81513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:17:22 devstack sudo[81513]: pam_unix(sudo:session): session closed for user root
Sep 18 13:17:22 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.903s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:17:22 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:17:22 devstack sudo[81560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:17:22 devstack sudo[81560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:17:24 devstack sudo[81560]: pam_unix(sudo:session): session closed for user root
Sep 18 13:17:24 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.932s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:17:24 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:17:24 devstack sudo[81564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:17:24 devstack sudo[81564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:17:26 devstack sudo[81564]: pam_unix(sudo:session): session closed for user root
Sep 18 13:17:26 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.994s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:17:26 devstack cinder-volume[75178]: DEBUG cinder.manager [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Notifying Schedulers of capabilities ... {{(pid=75178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:17:29 devstack cinder-volume[75178]: DEBUG dbcounter [-] [75178] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75178) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:18:18 devstack cinder-volume[75178]: DEBUG oslo_service.periodic_task [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75178) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:18:18 devstack cinder-volume[75178]: DEBUG cinder.volume.drivers.lvm [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Updating volume stats {{(pid=75178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 13:18:18 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:18:18 devstack sudo[81680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 13:18:18 devstack sudo[81680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:18:20 devstack sudo[81680]: pam_unix(sudo:session): session closed for user root
Sep 18 13:18:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.973s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:18:20 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:18:20 devstack sudo[81725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:18:20 devstack sudo[81725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:18:22 devstack sudo[81725]: pam_unix(sudo:session): session closed for user root
Sep 18 13:18:22 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.994s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:18:22 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:18:22 devstack sudo[81857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 13:18:22 devstack sudo[81857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:18:24 devstack sudo[81857]: pam_unix(sudo:session): session closed for user root
Sep 18 13:18:24 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.003s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:18:24 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:18:24 devstack sudo[81941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 13:18:24 devstack sudo[81941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:18:26 devstack sudo[81941]: pam_unix(sudo:session): session closed for user root
Sep 18 13:18:26 devstack cinder-volume[75178]: DEBUG oslo_concurrency.processutils [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.918s {{(pid=75178) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:18:26 devstack cinder-volume[75178]: DEBUG cinder.manager [None req-a54ca536-1e84-4249-93e5-4b6c97608cc0 None None] Notifying Schedulers of capabilities ... {{(pid=75178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:18:47 devstack cinder-volume[75031]: INFO oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Caught SIGTERM, stopping children
Sep 18 13:18:47 devstack cinder-volume[75031]: DEBUG oslo_concurrency.lockutils [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Acquiring lock "singleton_lock" {{(pid=75031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 13:18:47 devstack cinder-volume[75031]: DEBUG oslo_concurrency.lockutils [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Acquired lock "singleton_lock" {{(pid=75031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 13:18:47 devstack cinder-volume[75031]: DEBUG oslo_concurrency.lockutils [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Releasing lock "singleton_lock" {{(pid=75031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 13:18:47 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Stop services. {{(pid=75031) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 18 13:18:47 devstack cinder-volume[75031]: DEBUG oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Killing children. {{(pid=75031) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 18 13:18:47 devstack cinder-volume[75031]: INFO oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Waiting on 1 children to exit
Sep 18 13:18:50 devstack cinder-volume[75178]: DEBUG oslo_concurrency.lockutils [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Acquiring lock "singleton_lock" {{(pid=75178) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 13:18:50 devstack cinder-volume[75178]: DEBUG oslo_concurrency.lockutils [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Acquired lock "singleton_lock" {{(pid=75178) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 13:18:50 devstack cinder-volume[75178]: DEBUG oslo_concurrency.lockutils [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Releasing lock "singleton_lock" {{(pid=75178) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 13:18:51 devstack cinder-volume[75178]: WARNING amqp [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 18 13:18:51 devstack cinder-volume[75178]: WARNING amqp [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 18 13:18:51 devstack cinder-volume[75031]: INFO oslo_service.backend._eventlet.service [None req-d2e6d4f8-e605-44a2-9c16-f9f414ccc6ea None None] Child 75178 exited with status 0
Sep 18 13:19:06 devstack cinder-volume[82591]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82591) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 13:19:06 devstack cinder-volume[82591]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82591) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 13:19:06 devstack cinder-volume[82591]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82591) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 13:19:10 devstack cinder-volume[82591]: INFO dbcounter [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Registered counter for database cinder
Sep 18 13:19:10 devstack cinder-volume[82591]: DEBUG oslo_db.sqlalchemy.engines [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 13:19:11 devstack cinder-volume[82591]: DEBUG dbcounter [-] [82591] Writer thread running {{(pid=82591) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 13:19:11 devstack cinder-volume[82591]: INFO cinder.rpc [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 18 13:19:11 devstack cinder-volume[82591]: INFO cinder.rpc [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 18 13:19:11 devstack cinder-volume[82591]: DEBUG oslo_db.sqlalchemy.engines [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 13:19:11 devstack cinder-volume[82591]: INFO cinder.volume.manager [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Determined volume DB was empty at startup.
Sep 18 13:19:11 devstack cinder-volume[82591]: DEBUG cinder.volume.manager [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82591) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 18 13:19:12 devstack cinder-volume[82591]: INFO cinder.volume.manager [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 18 13:19:12 devstack cinder-volume[82591]: WARNING stevedore.named [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 13:19:12 devstack cinder-volume[82591]: WARNING castellan.key_manager [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 13:19:12 devstack cinder-volume[82591]: WARNING cinder.keymgr.conf_key_mgr [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 13:19:12 devstack cinder-volume[82591]: INFO cinder.volume.manager [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_db.sqlalchemy.engines [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 13:19:12 devstack cinder-volume[82591]: INFO oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Starting 1 workers
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Started child 82799 {{(pid=82591) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 18 13:19:12 devstack cinder-volume[82799]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Full set of CONF: {{(pid=82591) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] ******************************************************************************** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Configuration options gathered from: {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] ================================================================================ {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] allow_availability_zone_fallback = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] allow_compression_on_image_upload = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] allowed_direct_url_schemes     = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] api_rate_limit                 = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] auth_strategy                  = keystone {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_availability_zone      = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_host                   = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_name                   = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_stats_polling_interval = 60 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backup_api_class               = cinder.backup.api.API {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backup_name_template           = backup-%s {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backup_use_same_host           = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backup_use_temp_snapshot       = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] chap_password                  = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] chap_username                  =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cinder_internal_tenant_project_id = ccb908c76e73467ea811133875ae8b6b {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cinder_internal_tenant_user_id = 145e3a183e0c4d5ab10fb7a2bfe04b86 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cluster                        = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] compression_format             = gzip {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] compute_api_class              = cinder.compute.nova.API {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] config_dir                     = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] config_source                  = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] control_exchange               = openstack {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] debug                          = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] default_availability_zone      = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] default_group_type             = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] default_volume_type            = QuobyteHD {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] driver_client_cert             = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] driver_client_cert_key         = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] driver_data_namespace          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] driver_ssl_cert_path           = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] driver_ssl_cert_verify         = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] driver_use_ssl                 = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] enable_new_services            = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] enable_unsupported_driver      = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] enabled_backends               = ['QuobyteHD'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] enforce_multipath_for_image_xfer = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] filter_function                = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_api_insecure            = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_api_servers             = ['http://192.168.122.113/image'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_api_ssl_compression     = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_ca_certificates_file    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_catalog_info            = image:glance:publicURL {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_certfile                = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_keyfile                 = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_num_retries             = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance_request_timeout         = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] goodness_function              = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] graceful_shutdown_timeout      = 5 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] group_api_class                = cinder.group.api.API {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] host                           = devstack {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_compress_on_upload       = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_conversion_address_space_limit = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_conversion_cpu_limit     = 60 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_conversion_disable       = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_upload_use_cinder_backend = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_upload_use_internal_tenant = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_volume_cache_enabled     = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_volume_cache_max_count   = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] image_volume_cache_max_size_gb = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] init_host_max_objects_retrieval = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] instance_format                = [instance: %(uuid)s]  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] iscsi_iotype                   = fileio {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] iscsi_target_flags             =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] iscsi_write_cache              = on {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] iser_helper                    = tgtadm {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] iser_ip_address                = 192.168.122.113 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] iser_port                      = 3260 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] log_color                      = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] log_config_append              = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] log_dir                        = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] log_file                       = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] log_options                    = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] log_rotate_interval            = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] log_rotate_interval_type       = days {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] log_rotation_type              = none {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] max_age                        = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] max_logfile_count              = 30 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] max_logfile_size_mb            = 200 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] max_over_subscription_ratio    = 20.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] message_reap_interval          = 86400 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] message_ttl                    = 2592000 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] migration_create_volume_timeout_secs = 300 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] monkey_patch                   = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] monkey_patch_modules           = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] my_ip                          = 192.168.122.113 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] no_snapshot_gb_quota           = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] num_iser_scan_tries            = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] num_shell_tries                = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] num_volume_device_scan_tries   = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] nvmeof_conn_info_version       = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] nvmet_ns_id                    = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] nvmet_port_id                  = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] osapi_max_limit                = 1000 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] osapi_volume_ext_list          = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] osapi_volume_listen_port       = 8776 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] osapi_volume_use_ssl           = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] osapi_volume_workers           = 2 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] per_volume_size_limit          = -1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] periodic_fuzzy_delay           = 60 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] periodic_interval              = 60 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] public_endpoint                = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] publish_errors                 = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] quota_backup_gigabytes         = 1000 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] quota_backups                  = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] quota_gigabytes                = 1000 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] quota_groups                   = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] quota_snapshots                = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] quota_volumes                  = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] rate_limit_burst               = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] rate_limit_except_level        = CRITICAL {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] rate_limit_interval            = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] reinit_driver_count            = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] replication_device             = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] report_discard_supported       = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] report_interval                = 120 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] reservation_clean_interval     = 86400 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] reservation_expire             = 86400 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] reserved_image_namespaces      = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] reserved_percentage            = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] rpc_response_timeout           = 120 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] run_external_periodic_tasks    = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] scst_target_driver             = iscsi {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] scst_target_iqn_name           = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_down_time              = 720 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] shell_completion               = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] snapshot_name_template         = snapshot-%s {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] split_loggers                  = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] state_path                     = /opt/stack/data/cinder {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] storage_availability_zone      = nova {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] storage_protocol               = iSCSI {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] syslog_log_facility            = LOG_USER {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] target_helper                  = lioadm {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] target_ip_address              = 192.168.122.113 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] target_port                    = 3260 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] target_protocol                = iscsi {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] target_secondary_ip_addresses  = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] trace_flags                    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] transport_url                  = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] until_refresh                  = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] use_chap_auth                  = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] use_default_quota_class        = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] use_journal                    = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] use_json                       = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] use_multipath_for_image_xfer   = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] use_stderr                     = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] use_syslog                     = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] verify_glance_signatures       = enabled {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_api_class               = cinder.volume.api.API {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_backend_name            = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_clear                   = zero {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_clear_ionice            = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_clear_size              = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_copy_bps_limit          = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_dd_blocksize            = 1M {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_name_template           = volume-%s {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_service_inithost_offload = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volume_usage_audit_period      = month {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] watch_log_file                 = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] zoning_mode                    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_concurrency.disable_process_locking = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.admin_password = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.admin_token = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.admin_user  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.auth_port   = 35357 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.auth_protocol = https {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.auth_section = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.auth_type   = password {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.auth_uri    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.auth_version = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.cache       = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.certfile    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.delay_auth_decision = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.http_connect_timeout = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.identity_uri = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.include_service_catalog = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.insecure    = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.interface   = public {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.keyfile     = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_password =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcache_username =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.region_name = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.service_token_roles_required = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.service_type = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.token_cache_time = 300 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.backend                  = dogpile.cache.null {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.backend_argument         = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.backend_expiration_time  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.config_prefix            = cache.oslo {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.dead_timeout             = 60.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.debug_cache_backend      = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.enable_retry_client      = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.enable_socket_keepalive  = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.enabled                  = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.enforce_fips_mode        = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.expiration_time          = 600 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.hashclient_retry_attempts = 2 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_dead_retry      = 300 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_password        = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_pool_maxsize    = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_sasl_enabled    = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.memcache_username        = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.proxies                  = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.redis_db                 = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.redis_password           = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.redis_sentinel_service_name = mymaster {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.redis_server             = localhost:6379 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.redis_socket_timeout     = 1.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.redis_username           = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.retry_attempts           = 2 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.retry_delay              = 0.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.socket_keepalive_count   = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.socket_keepalive_idle    = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.socket_keepalive_interval = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.tls_allowed_ciphers      = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.tls_cafile               = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.tls_certfile             = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.tls_enabled              = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:12 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cache.tls_keyfile              = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] coordination.backend_url       = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.asyncio_connection    = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.asyncio_slave_connection = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.backend               = sqlalchemy {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.connection            = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.connection_debug      = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.connection_parameters =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.connection_recycle_time = 3600 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.connection_trace      = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.db_inc_retry_interval = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.db_max_retries        = 20 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.db_max_retry_interval = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.db_retry_interval     = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.max_overflow          = 50 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.max_pool_size         = 5 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.max_retries           = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.mysql_wsrep_sync_wait = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.pool_timeout          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.retry_interval        = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.slave_connection      = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.sqlite_synchronous    = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] database.use_db_reconnect      = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.connection_string     = messaging:// {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.enabled               = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.es_doc_type           = notification {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.es_scroll_size        = 10000 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.es_scroll_time        = 2m {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.filter_error_trace    = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.hmac_keys             = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.sentinel_service_name = mymaster {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.socket_timeout        = 0.1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.trace_requests        = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler.trace_sqlalchemy      = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler_jaeger.process_tags   = {} {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler_jaeger.service_name_prefix = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] profiler_otlp.service_name_prefix = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.enforce_new_defaults = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: WARNING oslo_config.cfg [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.enforce_scope      = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.policy_default_rule = default {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.policy_file        = policy.yaml {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] privsep_osbrick.group          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] privsep_osbrick.helper_command = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82799) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] privsep_osbrick.user           = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cinder_sys_admin.group         = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cinder_sys_admin.helper_command = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] cinder_sys_admin.user          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.auth_section      = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.auth_type         = password {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.certfile          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.collect_timing    = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.insecure          = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.keyfile           = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.send_service_user_token = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.split_loggers     = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] service_user.timeout           = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance.auth_section            = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance.auth_type               = password {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance.certfile                = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance.collect_timing          = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance.insecure                = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance.keyfile                 = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance.split_loggers           = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] glance.timeout                 = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.backend_availability_zone = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.chap_password = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.chap_username =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.driver_client_cert = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.driver_client_cert_key = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.driver_data_namespace = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.driver_use_ssl = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.enable_unsupported_driver = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.extra_capabilities = {} {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.filter_function = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.goodness_function = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.iscsi_iotype  = fileio {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.iscsi_target_flags =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.iscsi_write_cache = on {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.iser_helper   = tgtadm {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.iser_ip_address = 192.168.122.113 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.iser_port     = 3260 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_host      =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_login     = admin {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_mount_options = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_password  = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_private_key =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_share_path =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.num_shell_tries = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.nvmet_port_id = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.quobyte_client_cfg = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.quobyte_volume_url = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.replication_device = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.report_discard_supported = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.reserved_percentage = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.scst_target_driver = iscsi {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.scst_target_iqn_name = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.storage_protocol = iSCSI {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.target_helper = tgtadm {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.target_ip_address = 192.168.122.113 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.target_port   = 3260 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.target_protocol = iscsi {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.trace_flags   = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.unique_fqdn_network = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.use_chap_auth = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.volume_backend_name = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.volume_clear  = zero {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.volume_clear_ionice = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.volume_clear_size = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_reports.file_event_handler = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_reports.log_dir           = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.backend_availability_zone = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.backend_host         = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.chap_password        = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.chap_username        = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.chiscsi_conf         = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.driver_client_cert   = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.driver_client_cert_key = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.driver_data_namespace = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.driver_use_ssl       = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.extra_capabilities   = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.filter_function      = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.goodness_function    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.iscsi_iotype         = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.iser_helper          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.iser_ip_address      = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.iser_port            = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.iser_target_prefix   = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_host             = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_login            = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_mount_options    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_password         = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_private_key      = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_share_path       = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_ssh_port         = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.num_shell_tries      = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.nvmet_port_id        = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.replication_device   = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.report_discard_supported = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.reserved_percentage  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.scst_target_driver   = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.storage_protocol     = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.target_helper        = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.target_ip_address    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.target_port          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.target_prefix        = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.target_protocol      = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.trace_flags          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.use_chap_auth        = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.volume_clear         = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.volume_clear_size    = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] QuobyteHD.volumes_dir          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.ssl      = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_notifications.driver = [] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_notifications.retry = -1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] oslo_messaging_notifications.transport_url = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] key_manager.fixed_key          = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.barbican_api_version  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.barbican_endpoint     = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.barbican_endpoint_type = public {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.barbican_region_name  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.cafile                = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.certfile              = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.collect_timing        = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.insecure              = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.keyfile               = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.number_of_retries     = 60 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.retry_delay           = 1 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.send_service_user_token = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.split_loggers         = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.timeout               = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.verify_ssl            = True {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican.verify_ssl_path       = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican_service_user.auth_section = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican_service_user.auth_type = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican_service_user.cafile   = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican_service_user.certfile = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican_service_user.collect_timing = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican_service_user.insecure = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican_service_user.keyfile  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican_service_user.split_loggers = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] barbican_service_user.timeout  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.approle_role_id          = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.approle_secret_id        = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.kv_mountpoint            = secret {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.kv_path                  = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.kv_version               = 2 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.namespace                = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.root_token_id            = **** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.ssl_ca_crt_file          = None {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.timeout                  = 60.0 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.use_ssl                  = False {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 13:19:13 devstack cinder-volume[82591]: DEBUG oslo_service.backend._eventlet.service [None req-cd236da5-ef79-40b1-81a5-2aff4560018c None None] ******************************************************************************** {{(pid=82591) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 18 13:19:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82799) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 18 13:19:13 devstack cinder-volume[82799]: INFO cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 18 13:19:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Running cmd (subprocess): mount.quobyte {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:19:14 devstack quobyte-client[82812]: Reading configuration file: /etc/quobyte/client.cfg
Sep 18 13:19:14 devstack quobyte-client[82812]: Invalid parameters found, error: missing mount point.
Sep 18 13:19:14 devstack quobyte-client[82812]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 18 13:19:14 devstack quobyte-client[82812]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] CMD "mount.quobyte" returned: 1 in 0.440s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:19:14 devstack cinder-volume[82799]: INFO cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Mounting volume: 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 ...
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 -c /etc/quobyte/client-cinder.cfg {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:19:14 devstack quobyte-client[82818]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 18 13:19:14 devstack quobyte-client[82818]: Reading configuration file: /etc/quobyte/client.cfg
Sep 18 13:19:14 devstack quobyte-client[82818]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25' to display the log.
Sep 18 13:19:14 devstack quobyte-client[82822]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 18 13:19:14 devstack quobyte-client[82822]: mount.quobyte 3.25 (4fbbd59204)
Sep 18 13:19:14 devstack quobyte-client[82822]: Client UUID: 5khONsQI-BsEL-LKfE-ntyY-qLWN98tGtENb
Sep 18 13:19:14 devstack quobyte-client[82822]: Registry: osci01.corp.quobyte.com:7861
Sep 18 13:19:14 devstack quobyte-client[82822]: Volume: cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:19:14 devstack quobyte-client[82822]: FUSE version: 316
Sep 18 13:19:14 devstack quobyte-client[82822]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 18 13:19:14 devstack quobyte-client[82822]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 18 13:19:14 devstack quobyte-client[82822]: Setting total object cache size to 3352297472 bytes
Sep 18 13:19:14 devstack quobyte-client[82822]: Using FUSE low-level API
Sep 18 13:19:14 devstack quobyte-client[82822]: Caching of uid/gid to user/group name mappings is enabled
Sep 18 13:19:14 devstack quobyte-client[82822]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 18 13:19:14 devstack quobyte-client[82822]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 18 13:19:14 devstack quobyte-client[82822]: HTTP server started on port 55000
Sep 18 13:19:14 devstack quobyte-client[82822]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 18 13:19:14 devstack quobyte-client[82822]: Mount point /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 established
Sep 18 13:19:14 devstack quobyte-client[82822]: TimeSync is running and remote sync every 60 seconds
Sep 18 13:19:14 devstack quobyte-client[82822]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 13:19:14 devstack quobyte-client[82822]: Ignored time synchronization message because time source took too long to respond (75 ms)
Sep 18 13:19:14 devstack quobyte-client[82822]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 13:19:14 devstack quobyte-client[82822]: Opening volume cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 (df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe)
Sep 18 13:19:14 devstack quobyte-client[82822]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 18 13:19:14 devstack quobyte-client[82822]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 13:19:14 devstack quobyte-client[82822]: Failed to invalidate inode: 38: Function not implemented
Sep 18 13:19:14 devstack quobyte-client[82822]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 13:19:14 devstack quobyte-client[82822]: Automatic minidump upload enabled by global system configuration
Sep 18 13:19:14 devstack quobyte-client[82822]: Announcing HTTP status server address 172.24.4.1
Sep 18 13:19:14 devstack quobyte-client[82822]: Registered as service (uuid 5khONsQI-BsEL-LKfE-ntyY-qLWN98tGtENb)
Sep 18 13:19:14 devstack quobyte-client[82822]: Quobyte Client running as pid 82822
Sep 18 13:19:14 devstack quobyte-client[82822]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 18 13:19:14 devstack quobyte-client[82822]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.746s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:19:14 devstack cinder-volume[82799]: INFO cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Mounting volume: 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 succeeded
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.810s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:19:14 devstack quobyte-client[82822]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.074s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:19:14 devstack cinder-volume[82799]: INFO cinder.volume.driver [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Driver hasn't implemented _init_vendor_properties()
Sep 18 13:19:14 devstack cinder-volume[82799]: DEBUG cinder.volume.driver [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82799) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writer thread running {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG cinder.db.sqlalchemy.api [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Building query based on filter {{(pid=82799) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82799) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 18 13:19:15 devstack cinder-volume[82799]: INFO cinder.keymgr.migration [None req-c1b8e3ca-168c-4c1b-a8d1-feb006065aa1 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.084s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:19:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Driver initialization completed successfully.
Sep 18 13:19:15 devstack cinder-volume[82799]: INFO cinder.manager [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Initiating service 3 cleanup
Sep 18 13:19:15 devstack cinder-volume[82799]: INFO cinder.manager [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Service 3 cleanup completed.
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG cinder.service [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Creating RPC server for service cinder-volume {{(pid=82799) start /opt/stack/cinder/cinder/service.py:239}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG cinder.service [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82799) start /opt/stack/cinder/cinder/service.py:245}}
Sep 18 13:19:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 18 13:19:15 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:19:15 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:19:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:19:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:19:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.096s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:19:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bd3ed2a6-9fcb-40a3-b68a-5d63a79a7bc4 None None] Driver post RPC initialization completed successfully.
Sep 18 13:19:17 devstack quobyte-client[82822]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 13:19:22 devstack cinder-volume[82591]: DEBUG dbcounter [-] [82591] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82591) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:19:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:19:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:20:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:20:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:20:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:20:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:20:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:20:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:20:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.194s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:20:18 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:20:18 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:20:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Flow 'volume_create_manager' (c6e8742b-659e-4c83-b5c7-afbc73bbde6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:20:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50634a3-84ce-4410-abf3-db2491461e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50634a3-84ce-4410-abf3-db2491461e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1132224652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608fb9a6-c1a3-400c-80f7-69dc4edfaf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a184b954a2ce4ad8b29a711d6d48fd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:20:18Z,use_quota=True,user_id='9adf351b2a0049e3a9714ca2353e6c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fbb0f4-fcb5-4eca-8990-8ed2fd01c89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fbb0f4-fcb5-4eca-8990-8ed2fd01c89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ca6e5b-f1d0-45d9-aff9-507f2e226ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.image.glance [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Creating Keystone auth plugin from conf {{(pid=82799) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ca6e5b-f1d0-45d9-aff9-507f2e226ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '608fb9a6-c1a3-400c-80f7-69dc4edfaf41', 'volume_name': 'volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e96aac8e0>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486a8181-e617-4f6d-9c97-e26c45cbc4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486a8181-e617-4f6d-9c97-e26c45cbc4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803cf479-d438-4b49-9480-46bd91971443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:19 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Volume 608fb9a6-c1a3-400c-80f7-69dc4edfaf41: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e96aac8e0>}
Sep 18 13:20:19 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Cloning 608fb9a6-c1a3-400c-80f7-69dc4edfaf41 from image bcfddd9f-68c0-4f36-86c6-1809e131a4ca  at location (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]). {{(pid=82799) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 13:20:20 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 13:20:20 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 13:20:20 devstack cinder-volume[82799]: INFO oslo.privsep.daemon [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfv9rbx7o/privsep.sock']
Sep 18 13:20:20 devstack sudo[83107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfv9rbx7o/privsep.sock
Sep 18 13:20:20 devstack sudo[83107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:20:25 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Flow 'volume_create_manager' (dac8decf-72a6-45b9-b9e4-4cf0d35d2210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d548e8-8f02-4c35-b5f5-78c71a920cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d548e8-8f02-4c35-b5f5-78c71a920cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1926321618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078195e7ebe34d848ee0b7bbd3521c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:20:25Z,use_quota=True,user_id='07112bc934494e0db0bad3dc9f0c8b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd3e409-5d31-41b1-9739-50dfa7e22b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd3e409-5d31-41b1-9739-50dfa7e22b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51159cf6-c9b5-421c-851a-d46b1ce97bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51159cf6-c9b5-421c-851a-d46b1ce97bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d', 'volume_name': 'volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a42ae6d-f386-4862-bc45-d59601afea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a42ae6d-f386-4862-bc45-d59601afea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd59c3ea-a7ab-4b95-887e-aa3d11348164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:25 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Volume eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d', 'volume_size': 1}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1926321618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078195e7ebe34d848ee0b7bbd3521c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:20:25Z,use_quota=True,user_id='07112bc934494e0db0bad3dc9f0c8b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Creating volume eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:20:25 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:20:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:25 devstack quobyte-client[82822]: System call of process 83114 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:20:26 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=2, name=volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:20:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d 1073741824" returned: 0 in 1.307s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d" returned: 0 in 0.286s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] <== create_volume: return (1673ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd59c3ea-a7ab-4b95-887e-aa3d11348164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf6fc85-ab1f-4990-a589-056989daf673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:27 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Volume volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d (eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d): created successfully
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf6fc85-ab1f-4990-a589-056989daf673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Flow 'volume_create_manager' (dac8decf-72a6-45b9-b9e4-4cf0d35d2210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:20:27 devstack sudo[83107]: pam_unix(sudo:session): session closed for user root
Sep 18 13:20:27 devstack cinder-volume[82799]: INFO oslo.privsep.daemon [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Spawned new privsep daemon via rootwrap
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Accepted privsep connection to /tmp/tmpfv9rbx7o/privsep.sock {{(pid=82799) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 18 13:20:27 devstack cinder-volume[82799]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 18 13:20:27 devstack cinder-volume[82799]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 18 13:20:27 devstack cinder-volume[82799]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 18 13:20:27 devstack cinder-volume[82799]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83112
Sep 18 13:20:27 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-69869a9a-b915-4b01-a549-c90e12fa8ad1 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Created volume successfully.
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f1f22e-7340-4d50-9d2c-b0cc266f2275]: (2,) {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f186aafe-cd88-42fc-b709-1cacd45cff54]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:20:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:28 devstack sudo[83434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD
Sep 18 13:20:28 devstack sudo[83434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:20:30 devstack sudo[83434]: pam_unix(sudo:session): session closed for user root
Sep 18 13:20:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD" returned: 0 in 2.675s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:30 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Temporary image bcfddd9f-68c0-4f36-86c6-1809e131a4ca is fetched for user 9adf351b2a0049e3a9714ca2353e6c3b. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 13:20:30 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad205c-8a98-4547-ac6f-9308042df90b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:20:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:31 devstack sudo[83441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD
Sep 18 13:20:31 devstack sudo[83441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:20:33 devstack sudo[83441]: pam_unix(sudo:session): session closed for user root
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD" returned: 0 in 2.520s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1132224652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608fb9a6-c1a3-400c-80f7-69dc4edfaf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a184b954a2ce4ad8b29a711d6d48fd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:20:18Z,use_quota=True,user_id='9adf351b2a0049e3a9714ca2353e6c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Creating volume 608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:20:33 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:33 devstack quobyte-client[82822]: System call of process 83448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:20:33 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=3, name=volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 1073741824" returned: 0 in 0.524s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" returned: 0 in 0.147s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] <== create_volume: return (773ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:20:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:20:34 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Attempting download of bcfddd9f-68c0-4f36-86c6-1809e131a4ca ((None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}])) to volume 608fb9a6-c1a3-400c-80f7-69dc4edfaf41. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 13:20:34 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb3b7d2-ab7d-44fc-bb1c-9cf013f1f7db]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:20:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__egxmsjv {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__egxmsjv" returned: 0 in 0.821s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__egxmsjv {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__egxmsjv" returned: 1 in 0.816s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__egxmsjv' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:20:36 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b0f35c-bded-4b89-8f78-b1b92c8863f3]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:20:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:37 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] bcfddd9f-68c0-4f36-86c6-1809e131a4ca was qcow2, converting to raw {{(pid=82799) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 13:20:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:37 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=3, name=volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:20:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" returned: 0 in 1.841s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:39 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_i2vm77gtdevstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:20:39 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Converted 112.00 MB image at 59.86 MB/s
Sep 18 13:20:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 1G" returned: 0 in 0.277s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:39 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf8592e-1330-473a-b4ce-4f44592b9236]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:20:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" returned: 0 in 0.682s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" returned: 1 in 0.495s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:20:40 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Downloaded image bcfddd9f-68c0-4f36-86c6-1809e131a4ca ((None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}])) to volume 608fb9a6-c1a3-400c-80f7-69dc4edfaf41 successfully. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 13:20:40 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Temporary image bcfddd9f-68c0-4f36-86c6-1809e131a4ca for user 9adf351b2a0049e3a9714ca2353e6c3b is deleted. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 13:20:40 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Marking volume 608fb9a6-c1a3-400c-80f7-69dc4edfaf41 as bootable. {{(pid=82799) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 13:20:41 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Copying metadata from image bcfddd9f-68c0-4f36-86c6-1809e131a4ca to 608fb9a6-c1a3-400c-80f7-69dc4edfaf41. {{(pid=82799) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 13:20:41 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Creating volume glance metadata for volume 608fb9a6-c1a3-400c-80f7-69dc4edfaf41 backed by image bcfddd9f-68c0-4f36-86c6-1809e131a4ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82799) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 13:20:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803cf479-d438-4b49-9480-46bd91971443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e96aac8e0>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed31f1a3-ac5a-4914-85b4-736746c547a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:41 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Volume volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 (608fb9a6-c1a3-400c-80f7-69dc4edfaf41): created successfully
Sep 18 13:20:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed31f1a3-ac5a-4914-85b4-736746c547a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Flow 'volume_create_manager' (c6e8742b-659e-4c83-b5c7-afbc73bbde6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:20:41 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c85c595c-306d-4e34-affb-48e3db3f2bf9 tempest-TaggedBootDevicesTest-889601151 None] Created volume successfully.
Sep 18 13:20:42 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:20:42 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Flow 'volume_create_manager' (00cd23d2-b611-479b-91ac-7913e40c3748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6185d64d-df14-4377-ac02-fcd2d500959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6185d64d-df14-4377-ac02-fcd2d500959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-252868224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065547a7-7891-43b4-9a26-0bf3c3fc9004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a184b954a2ce4ad8b29a711d6d48fd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:20:43Z,use_quota=True,user_id='9adf351b2a0049e3a9714ca2353e6c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde384e3-6087-4f49-bbce-b2df5b9faeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde384e3-6087-4f49-bbce-b2df5b9faeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ad0de1-ffcf-488e-930b-afcc8dea5512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ad0de1-ffcf-488e-930b-afcc8dea5512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065547a7-7891-43b4-9a26-0bf3c3fc9004', 'volume_name': 'volume-065547a7-7891-43b4-9a26-0bf3c3fc9004', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec4486e-ec4d-4188-847c-77206cd4077d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec4486e-ec4d-4188-847c-77206cd4077d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e77bb0-0327-4711-8a51-8a02582bbb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:43 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Volume 065547a7-7891-43b4-9a26-0bf3c3fc9004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065547a7-7891-43b4-9a26-0bf3c3fc9004', 'volume_size': 1}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-252868224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065547a7-7891-43b4-9a26-0bf3c3fc9004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a184b954a2ce4ad8b29a711d6d48fd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:20:43Z,use_quota=True,user_id='9adf351b2a0049e3a9714ca2353e6c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Creating volume 065547a7-7891-43b4-9a26-0bf3c3fc9004 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:20:43 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:20:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:43 devstack quobyte-client[82822]: System call of process 83514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:20:43 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=4, name=volume-065547a7-7891-43b4-9a26-0bf3c3fc9004, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:20:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004 1073741824" returned: 0 in 0.668s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004" returned: 0 in 0.234s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:44 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] <== create_volume: return (1007ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:20:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:20:44 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e77bb0-0327-4711-8a51-8a02582bbb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065547a7-7891-43b4-9a26-0bf3c3fc9004', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:44 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03dd24c-db0a-4f36-9ba6-9d8635548678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:44 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Volume volume-065547a7-7891-43b4-9a26-0bf3c3fc9004 (065547a7-7891-43b4-9a26-0bf3c3fc9004): created successfully
Sep 18 13:20:44 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03dd24c-db0a-4f36-9ba6-9d8635548678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:44 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Flow 'volume_create_manager' (00cd23d2-b611-479b-91ac-7913e40c3748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:20:45 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-12ddc17c-b490-402f-9c2f-6bc256909cad tempest-TaggedBootDevicesTest-889601151 None] Created volume successfully.
Sep 18 13:20:46 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Flow 'volume_create_manager' (d524e9a6-cc76-49f2-8095-e64275b88ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40bb33f-5c12-46b7-9581-34222b73182f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40bb33f-5c12-46b7-9581-34222b73182f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-548435806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627186a9-2feb-4f27-8885-100d916b1362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a184b954a2ce4ad8b29a711d6d48fd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:20:46Z,use_quota=True,user_id='9adf351b2a0049e3a9714ca2353e6c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad93ac4-a8f0-46f5-9264-61b35313fa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad93ac4-a8f0-46f5-9264-61b35313fa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538579e0-a561-4221-9bec-ca5a5c3ef7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538579e0-a561-4221-9bec-ca5a5c3ef7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '627186a9-2feb-4f27-8885-100d916b1362', 'volume_name': 'volume-627186a9-2feb-4f27-8885-100d916b1362', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9331a4-6b52-44d9-a00d-e96d804ddb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9331a4-6b52-44d9-a00d-e96d804ddb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e763e7-7454-4258-8d52-2c747dee3609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:46 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Volume 627186a9-2feb-4f27-8885-100d916b1362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-627186a9-2feb-4f27-8885-100d916b1362', 'volume_size': 1}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-548435806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627186a9-2feb-4f27-8885-100d916b1362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a184b954a2ce4ad8b29a711d6d48fd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:20:46Z,use_quota=True,user_id='9adf351b2a0049e3a9714ca2353e6c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Creating volume 627186a9-2feb-4f27-8885-100d916b1362 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:20:46 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:20:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:47 devstack quobyte-client[82822]: System call of process 83538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:20:47 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=5, name=volume-627186a9-2feb-4f27-8885-100d916b1362, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:20:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362 1073741824" returned: 0 in 0.613s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:20:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362" returned: 0 in 0.324s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:20:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] <== create_volume: return (1095ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:20:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:20:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e763e7-7454-4258-8d52-2c747dee3609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627186a9-2feb-4f27-8885-100d916b1362', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7959b09-ce44-4882-96dc-4f02a0ccc85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:20:48 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Volume volume-627186a9-2feb-4f27-8885-100d916b1362 (627186a9-2feb-4f27-8885-100d916b1362): created successfully
Sep 18 13:20:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7959b09-ce44-4882-96dc-4f02a0ccc85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:20:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Flow 'volume_create_manager' (d524e9a6-cc76-49f2-8095-e64275b88ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:20:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-06e8cbbc-2e1e-4584-8f65-e8200763694e tempest-TaggedBootDevicesTest-889601151 None] Created volume successfully.
Sep 18 13:20:58 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:20:58 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=12,cinder:SELECT=15,cinder:INSERT=13,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:21:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:21:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:21:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:21:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:21:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:21:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:21:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:21:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.379s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:21:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:21:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:21:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:21:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:21:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.044s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:21:53 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8090cd4-69d5-4c4c-a3b6-be4e45639d3a]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:21:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:21:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" returned: 0 in 2.895s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:21:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:21:58 devstack quobyte-client[82822]: System call of process 83888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:21:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" returned: 1 in 1.371s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:21:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:21:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.089s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:21:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12356815-83f8-4359-9eb8-0d9fcb4212d2', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:21:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:21:59 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-fcbf729a-8035-42d9-aff9-ed2c5310e22f tempest-TaggedBootDevicesTest-889601151 None] attachment_update completed successfully.
Sep 18 13:22:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-bede833f-aecf-4c5e-8390-95dab1871286 tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:22:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-bede833f-aecf-4c5e-8390-95dab1871286 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:22:05 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba44e062-2c4b-4489-9bd8-128c81533efc]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:22:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-bede833f-aecf-4c5e-8390-95dab1871286 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:22:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-bede833f-aecf-4c5e-8390-95dab1871286 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004" returned: 0 in 1.481s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:22:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-bede833f-aecf-4c5e-8390-95dab1871286 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.615s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:22:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-bede833f-aecf-4c5e-8390-95dab1871286 tempest-TaggedBootDevicesTest-889601151 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-065547a7-7891-43b4-9a26-0bf3c3fc9004', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d57cb6c-9c01-4055-b3fc-008bcebc507d', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:22:07 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-bede833f-aecf-4c5e-8390-95dab1871286 tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:22:07 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-bede833f-aecf-4c5e-8390-95dab1871286 tempest-TaggedBootDevicesTest-889601151 None] attachment_update completed successfully.
Sep 18 13:22:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-1c3466cd-dde7-480b-91d2-c643bae89325 tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:22:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-1c3466cd-dde7-480b-91d2-c643bae89325 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:22:11 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3f4454-99d3-497a-8d8f-aff5812f8234]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:22:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-1c3466cd-dde7-480b-91d2-c643bae89325 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:22:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:22:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:22:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:22:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:22:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:22:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.076s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:22:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:22:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-1c3466cd-dde7-480b-91d2-c643bae89325 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362" returned: 0 in 1.499s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:22:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-1c3466cd-dde7-480b-91d2-c643bae89325 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.610s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:22:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.829s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:22:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:22:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-1c3466cd-dde7-480b-91d2-c643bae89325 tempest-TaggedBootDevicesTest-889601151 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-627186a9-2feb-4f27-8885-100d916b1362', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc673d1b-a737-41d4-ae64-8728925b32a1', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:22:13 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-1c3466cd-dde7-480b-91d2-c643bae89325 tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:22:14 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-cab0ed49-67b5-4d02-a3e9-c0b5db091799 req-1c3466cd-dde7-480b-91d2-c643bae89325 tempest-TaggedBootDevicesTest-889601151 None] attachment_update completed successfully.
Sep 18 13:22:24 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:22:24 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:22:38 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:22:38 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:22:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Flow 'volume_create_manager' (c84482eb-56b3-448d-8e6a-45a2ee1d0a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:22:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6384ef6e-c034-419d-b108-c428bb74ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:22:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6384ef6e-c034-419d-b108-c428bb74ca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1039299445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c45161-8a4d-445c-a936-77d8a7589b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8c809a814f4063bb576e791e3f282e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:22:38Z,use_quota=True,user_id='c70b32b6acb94ed2980d65914b77afaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:22:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9055f0-7265-44ce-82d6-a23c555dcb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:22:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9055f0-7265-44ce-82d6-a23c555dcb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afe97c3-2cc4-494d-8738-18aa3855d02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afe97c3-2cc4-494d-8738-18aa3855d02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c45161-8a4d-445c-a936-77d8a7589b2d', 'volume_name': 'volume-85c45161-8a4d-445c-a936-77d8a7589b2d', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78735ebf-e963-41c7-8d87-b8ac77258353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78735ebf-e963-41c7-8d87-b8ac77258353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f4711e-620e-4ede-93d5-09172ee2a784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:22:39 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Volume 85c45161-8a4d-445c-a936-77d8a7589b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c45161-8a4d-445c-a936-77d8a7589b2d', 'volume_size': 1}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1039299445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c45161-8a4d-445c-a936-77d8a7589b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8c809a814f4063bb576e791e3f282e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:22:38Z,use_quota=True,user_id='c70b32b6acb94ed2980d65914b77afaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Creating volume 85c45161-8a4d-445c-a936-77d8a7589b2d {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.176s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:22:39 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:22:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:22:41 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=6, name=volume-85c45161-8a4d-445c-a936-77d8a7589b2d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:22:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d 1073741824" returned: 0 in 3.645s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:22:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:22:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d" returned: 0 in 1.276s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:22:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] <== create_volume: return (5642ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:22:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.768s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:22:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f4711e-620e-4ede-93d5-09172ee2a784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c45161-8a4d-445c-a936-77d8a7589b2d', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:22:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75feb2f-818c-4111-b144-2851792750a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:22:46 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Volume volume-85c45161-8a4d-445c-a936-77d8a7589b2d (85c45161-8a4d-445c-a936-77d8a7589b2d): created successfully
Sep 18 13:22:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75feb2f-818c-4111-b144-2851792750a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:22:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Flow 'volume_create_manager' (c84482eb-56b3-448d-8e6a-45a2ee1d0a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:22:46 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-65932136-1361-4cac-80ce-d0c1d0c51df6 tempest-AttachSCSIVolumeTestJSON-98858497 None] Created volume successfully.
Sep 18 13:22:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-65159272-2189-4c18-a90b-625fab4757f9 req-d879f972-aac9-4bfd-b920-4671af154943 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:22:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-65159272-2189-4c18-a90b-625fab4757f9 req-d879f972-aac9-4bfd-b920-4671af154943 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.034s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:22:54 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3579f7-7f08-413f-abae-1eea7f8911b8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:22:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-65159272-2189-4c18-a90b-625fab4757f9 req-d879f972-aac9-4bfd-b920-4671af154943 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:22:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-65159272-2189-4c18-a90b-625fab4757f9 req-d879f972-aac9-4bfd-b920-4671af154943 tempest-VolumesAssistedSnapshotsTest-1812271943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d" returned: 0 in 1.325s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:22:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-65159272-2189-4c18-a90b-625fab4757f9 req-d879f972-aac9-4bfd-b920-4671af154943 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.566s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:22:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-bbfbe347-ac7c-41be-a551-3a1386f83503 req-86f17ec8-f6f9-4f0a-9f26-56938d622cc1 tempest-AttachSCSIVolumeTestJSON-98858497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:22:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-bbfbe347-ac7c-41be-a551-3a1386f83503 req-86f17ec8-f6f9-4f0a-9f26-56938d622cc1 tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:22:55 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaae5e7-19c9-46cd-8172-bac127119edf]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:22:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-bbfbe347-ac7c-41be-a551-3a1386f83503 req-86f17ec8-f6f9-4f0a-9f26-56938d622cc1 tempest-AttachSCSIVolumeTestJSON-98858497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:22:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-65159272-2189-4c18-a90b-625fab4757f9 req-d879f972-aac9-4bfd-b920-4671af154943 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edbf0f51-3e55-4722-acfa-15d969452805', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:22:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-65159272-2189-4c18-a90b-625fab4757f9 req-d879f972-aac9-4bfd-b920-4671af154943 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:22:58 devstack quobyte-client[82822]: System call of process 84938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:22:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-bbfbe347-ac7c-41be-a551-3a1386f83503 req-86f17ec8-f6f9-4f0a-9f26-56938d622cc1 tempest-AttachSCSIVolumeTestJSON-98858497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d" returned: 0 in 2.211s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:22:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-bbfbe347-ac7c-41be-a551-3a1386f83503 req-86f17ec8-f6f9-4f0a-9f26-56938d622cc1 tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.348s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:22:58 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-65159272-2189-4c18-a90b-625fab4757f9 req-d879f972-aac9-4bfd-b920-4671af154943 tempest-VolumesAssistedSnapshotsTest-1812271943 None] attachment_update completed successfully.
Sep 18 13:22:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-bbfbe347-ac7c-41be-a551-3a1386f83503 req-86f17ec8-f6f9-4f0a-9f26-56938d622cc1 tempest-AttachSCSIVolumeTestJSON-98858497 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-85c45161-8a4d-445c-a936-77d8a7589b2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74938c47-23da-4648-a9f4-6b69b8e17a4d', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:22:58 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-bbfbe347-ac7c-41be-a551-3a1386f83503 req-86f17ec8-f6f9-4f0a-9f26-56938d622cc1 tempest-AttachSCSIVolumeTestJSON-98858497 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:22:58 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-bbfbe347-ac7c-41be-a551-3a1386f83503 req-86f17ec8-f6f9-4f0a-9f26-56938d622cc1 tempest-AttachSCSIVolumeTestJSON-98858497 None] attachment_update completed successfully.
Sep 18 13:23:08 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:23:08 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:23:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:23:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:23:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:23:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:23:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:23:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:23:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:23:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.212s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:23:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:23:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:23:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:23:31 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-4e89fb0f-1256-494f-85d9-9faa9270f678 req-804b8114-a2cc-4031-bd8c-c4f809f51458 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:23:31 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-4e89fb0f-1256-494f-85d9-9faa9270f678 req-804b8114-a2cc-4031-bd8c-c4f809f51458 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:23:31 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-4e89fb0f-1256-494f-85d9-9faa9270f678 req-804b8114-a2cc-4031-bd8c-c4f809f51458 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Terminate volume connection completed successfully.
Sep 18 13:23:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-4e89fb0f-1256-494f-85d9-9faa9270f678 req-804b8114-a2cc-4031-bd8c-c4f809f51458 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Deleting attachment edbf0f51-3e55-4722-acfa-15d969452805. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:23:32 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-6c69581a-8870-4786-91f8-1aa6618d9964 req-8092a42e-271a-4088-b29e-1794cfc50c35 tempest-AttachSCSIVolumeTestJSON-98858497 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:23:32 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-6c69581a-8870-4786-91f8-1aa6618d9964 req-8092a42e-271a-4088-b29e-1794cfc50c35 tempest-AttachSCSIVolumeTestJSON-98858497 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:23:32 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-6c69581a-8870-4786-91f8-1aa6618d9964 req-8092a42e-271a-4088-b29e-1794cfc50c35 tempest-AttachSCSIVolumeTestJSON-98858497 None] Terminate volume connection completed successfully.
Sep 18 13:23:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-6c69581a-8870-4786-91f8-1aa6618d9964 req-8092a42e-271a-4088-b29e-1794cfc50c35 tempest-AttachSCSIVolumeTestJSON-98858497 None] Deleting attachment 74938c47-23da-4648-a9f4-6b69b8e17a4d. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:23:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Acquiring lock "cinder-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:23:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "cinder-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:23:33 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:23:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Acquiring lock "cinder-quobyte-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:23:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "cinder-quobyte-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d" acquired by "delete_volume" :: waited 0.039s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:23:33 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c659e952-3da4-4df4-937e-0a2bb6553650]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:23:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:23:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d" returned: 0 in 0.635s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:23:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:23:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d" returned: 0 in 0.139s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:23:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "cinder-quobyte-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d" released by "delete_volume" :: held 0.992s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:23:34 devstack cinder-volume[82799]: WARNING cinder.quota [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:23:34 devstack cinder-volume[82799]: WARNING cinder.quota [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:23:34 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Created reservations ['991957b1-0d75-43df-b49f-c5626afcaa5f', '6cce47f7-776d-48a0-bcad-88200b02e169', '2572a2e6-c24d-4b88-a340-7774da3f6fe9', '2d0c2e1e-b043-4199-8993-bba8bee45b2b'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:23:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:23:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:23:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:23:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:23:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:23:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:23:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.366s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:23:36 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:23:36 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Deleted volume successfully.
Sep 18 13:23:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1af615e7-b6fa-498d-a19f-835191e59993 tempest-VolumesAssistedSnapshotsTest-1812271943 None] Lock "cinder-eaa4ff7a-befd-4d8b-a2e4-791c41ab2e8d-delete_volume" released by "delete_volume" :: held 4.367s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:23:45 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:23:47 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:23:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Acquiring lock "cinder-85c45161-8a4d-445c-a936-77d8a7589b2d-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:23:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "cinder-85c45161-8a4d-445c-a936-77d8a7589b2d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:23:52 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:23:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Acquiring lock "cinder-quobyte-85c45161-8a4d-445c-a936-77d8a7589b2d" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:23:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "cinder-quobyte-85c45161-8a4d-445c-a936-77d8a7589b2d" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:23:53 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fd9ddd-f51c-4d4d-807c-c9972ce628d5]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:23:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:23:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d" returned: 0 in 0.761s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:23:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-85c45161-8a4d-445c-a936-77d8a7589b2d" returned: 0 in 0.196s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "cinder-quobyte-85c45161-8a4d-445c-a936-77d8a7589b2d" released by "delete_volume" :: held 1.187s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Created reservations ['c75b64ab-fddc-4a5e-b3fe-77332c3269aa', '14a40c49-1db9-40ae-8b97-16808ac6b8dd', '7ed88d31-6012-4518-97cb-c78c905b46fd', '2e49e950-ff00-4ae7-a596-ed9c27f1ae76'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.182s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:23:54 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:23:55 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Deleted volume successfully.
Sep 18 13:23:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9b8a3cc3-6fff-464e-b36a-0244ef3ed32c tempest-AttachSCSIVolumeTestJSON-98858497 None] Lock "cinder-85c45161-8a4d-445c-a936-77d8a7589b2d-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:24:04 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=12,cinder:SELECT=6,cinder:INSERT=4 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:24:05 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:24:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:24:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:24:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:24:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:24:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:24:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:24:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:24:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.295s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:24:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:25:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:25:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:25:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:25:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:25:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:25:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:25:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.239s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:25:15 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-dd22f6f4-fbc8-4dc0-8c68-328d79907b2f tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-dd22f6f4-fbc8-4dc0-8c68-328d79907b2f tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-dd22f6f4-fbc8-4dc0-8c68-328d79907b2f tempest-TaggedBootDevicesTest-889601151 None] Terminate volume connection completed successfully.
Sep 18 13:25:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-dd22f6f4-fbc8-4dc0-8c68-328d79907b2f tempest-TaggedBootDevicesTest-889601151 None] Deleting attachment 12356815-83f8-4359-9eb8-0d9fcb4212d2. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:25:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-a6a771b3-6467-4e56-a7b9-07a18ac73cf0 tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-a6a771b3-6467-4e56-a7b9-07a18ac73cf0 tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-a6a771b3-6467-4e56-a7b9-07a18ac73cf0 tempest-TaggedBootDevicesTest-889601151 None] Terminate volume connection completed successfully.
Sep 18 13:25:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-a6a771b3-6467-4e56-a7b9-07a18ac73cf0 tempest-TaggedBootDevicesTest-889601151 None] Deleting attachment 8d57cb6c-9c01-4055-b3fc-008bcebc507d. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:25:17 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-f88af693-43f0-4507-bb4b-acf3e536f2fc tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:17 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-f88af693-43f0-4507-bb4b-acf3e536f2fc tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:17 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-f88af693-43f0-4507-bb4b-acf3e536f2fc tempest-TaggedBootDevicesTest-889601151 None] Terminate volume connection completed successfully.
Sep 18 13:25:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-0bbb0912-6de4-4ecf-8f3b-9c84b2a5407b req-f88af693-43f0-4507-bb4b-acf3e536f2fc tempest-TaggedBootDevicesTest-889601151 None] Deleting attachment dc673d1b-a737-41d4-ae64-8728925b32a1. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:25:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:25:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=4 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:25:32 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Flow 'volume_create_manager' (10242daa-d79e-4c6c-bf43-56abc11ffaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54baf22-73f3-4b1b-8202-ef0c3bc1b839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54baf22-73f3-4b1b-8202-ef0c3bc1b839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1856750557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78117104-ca4a-4589-a9d1-f445ecbda465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ef84b14bb540319076836326f4fef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:25:32Z,use_quota=True,user_id='6bbf55525abf4d55a25f9cc900339443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6dd760-a758-4d73-a932-45d9c33a1497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6dd760-a758-4d73-a932-45d9c33a1497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b78b1d-9d1c-4e3f-8e77-a1ab4554e969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b78b1d-9d1c-4e3f-8e77-a1ab4554e969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78117104-ca4a-4589-a9d1-f445ecbda465', 'volume_name': 'volume-78117104-ca4a-4589-a9d1-f445ecbda465', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4937b107-43ba-4dfb-8ef4-d47230c1d411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4937b107-43ba-4dfb-8ef4-d47230c1d411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba70455a-9011-4c1a-91e2-4a001742491e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:25:32 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Volume 78117104-ca4a-4589-a9d1-f445ecbda465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78117104-ca4a-4589-a9d1-f445ecbda465', 'volume_size': 1}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1856750557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78117104-ca4a-4589-a9d1-f445ecbda465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ef84b14bb540319076836326f4fef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:25:32Z,use_quota=True,user_id='6bbf55525abf4d55a25f9cc900339443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Creating volume 78117104-ca4a-4589-a9d1-f445ecbda465 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:25:32 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:32 devstack quobyte-client[82822]: System call of process 86034 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:25:32 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=7, name=volume-78117104-ca4a-4589-a9d1-f445ecbda465, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:25:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "cinder-627186a9-2feb-4f27-8885-100d916b1362-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465 1073741824" returned: 0 in 0.621s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-627186a9-2feb-4f27-8885-100d916b1362-delete_volume" acquired by "delete_volume" :: waited 0.338s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465" returned: 0 in 0.405s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] <== create_volume: return (1076ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:25:33 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "cinder-quobyte-627186a9-2feb-4f27-8885-100d916b1362" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba70455a-9011-4c1a-91e2-4a001742491e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78117104-ca4a-4589-a9d1-f445ecbda465', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a88489f-4565-4e7b-93f6-1f039734c548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-quobyte-627186a9-2feb-4f27-8885-100d916b1362" acquired by "delete_volume" :: waited 0.135s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:25:33 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Volume volume-78117104-ca4a-4589-a9d1-f445ecbda465 (78117104-ca4a-4589-a9d1-f445ecbda465): created successfully
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a88489f-4565-4e7b-93f6-1f039734c548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Flow 'volume_create_manager' (10242daa-d79e-4c6c-bf43-56abc11ffaef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[90649b86-8589-4502-b19a-8a8c5fea7f1c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:25:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4c78b4c7-c358-4c5d-95b2-0c2db2a1afd4 tempest-DeleteServersTestJSON-178307861 None] Created volume successfully.
Sep 18 13:25:34 devstack quobyte-client[82822]: System call of process 86038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:25:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362" returned: 0 in 0.991s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-627186a9-2feb-4f27-8885-100d916b1362" returned: 0 in 0.136s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-quobyte-627186a9-2feb-4f27-8885-100d916b1362" released by "delete_volume" :: held 1.328s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Created reservations ['56abea2e-fc1c-4274-a5e9-08bc4187ad3e', '2f657318-344b-446f-98c9-319e3ed5a9aa', '4cc0aed9-ad10-41e3-8c49-9134e3820d5e', 'a4c8cd54-bb5a-487d-9fb0-411727dd130d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.202s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:35 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:25:36 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Deleted volume successfully.
Sep 18 13:25:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "cinder-065547a7-7891-43b4-9a26-0bf3c3fc9004-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:25:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-65c1d008-0f82-473b-82aa-c5dfa1862a8d tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-627186a9-2feb-4f27-8885-100d916b1362-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:25:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-065547a7-7891-43b4-9a26-0bf3c3fc9004-delete_volume" acquired by "delete_volume" :: waited 0.204s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:25:36 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "cinder-quobyte-065547a7-7891-43b4-9a26-0bf3c3fc9004" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:25:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-quobyte-065547a7-7891-43b4-9a26-0bf3c3fc9004" acquired by "delete_volume" :: waited 0.031s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:25:36 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2011738-b251-46f2-b5f8-3899dbe008a8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:25:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004" returned: 0 in 0.804s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-065547a7-7891-43b4-9a26-0bf3c3fc9004" returned: 0 in 0.185s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-quobyte-065547a7-7891-43b4-9a26-0bf3c3fc9004" released by "delete_volume" :: held 1.225s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:25:38 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Created reservations ['03315a25-2478-40f0-870d-92f057d43b31', '50bf0372-33b6-40ab-8360-bfe3794c34b4', 'a1d65548-6cde-4d95-8ecd-b4d1f3156336', '54fb2922-d327-47b0-a110-4f1fac090216'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:25:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:25:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:25:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:25:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:25:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:25:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.287s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:39 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:25:39 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Deleted volume successfully.
Sep 18 13:25:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "cinder-608fb9a6-c1a3-400c-80f7-69dc4edfaf41-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:25:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06364d1e-abfb-494e-a9dc-4e7e172ee65f tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-065547a7-7891-43b4-9a26-0bf3c3fc9004-delete_volume" released by "delete_volume" :: held 3.749s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:25:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-7905acc3-5615-49c2-af86-f4f7bd6ff20a req-f9cd6862-7e68-4e39-8d50-903e8b4d43aa tempest-DeleteServersTestJSON-178307861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:25:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-7905acc3-5615-49c2-af86-f4f7bd6ff20a req-f9cd6862-7e68-4e39-8d50-903e8b4d43aa tempest-DeleteServersTestJSON-178307861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:25:40 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[4953668b-0a72-4140-92fb-3460aad02807]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:25:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-608fb9a6-c1a3-400c-80f7-69dc4edfaf41-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:25:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7905acc3-5615-49c2-af86-f4f7bd6ff20a req-f9cd6862-7e68-4e39-8d50-903e8b4d43aa tempest-DeleteServersTestJSON-178307861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:41 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "cinder-quobyte-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:25:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-quobyte-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" acquired by "delete_volume" :: waited 0.090s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:25:41 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[430b2e56-0950-46d0-8ae7-71e805b3f4bc]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:25:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7905acc3-5615-49c2-af86-f4f7bd6ff20a req-f9cd6862-7e68-4e39-8d50-903e8b4d43aa tempest-DeleteServersTestJSON-178307861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465" returned: 0 in 1.176s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-7905acc3-5615-49c2-af86-f4f7bd6ff20a req-f9cd6862-7e68-4e39-8d50-903e8b4d43aa tempest-DeleteServersTestJSON-178307861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.325s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:25:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" returned: 0 in 0.774s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:42 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-7905acc3-5615-49c2-af86-f4f7bd6ff20a req-f9cd6862-7e68-4e39-8d50-903e8b4d43aa tempest-DeleteServersTestJSON-178307861 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-78117104-ca4a-4589-a9d1-f445ecbda465', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f8e935b-dbf7-4db6-929b-ca7cd8189829', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:25:42 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-7905acc3-5615-49c2-af86-f4f7bd6ff20a req-f9cd6862-7e68-4e39-8d50-903e8b4d43aa tempest-DeleteServersTestJSON-178307861 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:25:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-7905acc3-5615-49c2-af86-f4f7bd6ff20a req-f9cd6862-7e68-4e39-8d50-903e8b4d43aa tempest-DeleteServersTestJSON-178307861 None] attachment_update completed successfully.
Sep 18 13:25:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" returned: 1 in 0.977s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:25:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" returned: 0 in 0.163s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-quobyte-608fb9a6-c1a3-400c-80f7-69dc4edfaf41" released by "delete_volume" :: held 2.223s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:25:43 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Created reservations ['a147f132-9c2a-456e-b1bc-309ed6e5672e', 'e8d3844c-a33e-4696-ab83-c5cb67306046', '1b1d6e7f-8356-4d59-b70a-aa38f2c9ad56', 'c200b4b9-4a89-4a30-b22f-f895e449e422'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:25:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:25:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:25:44 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:25:44 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:25:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:25:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:25:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.111s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:25:44 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:25:44 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Deleted volume successfully.
Sep 18 13:25:44 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c8ab3932-0915-49eb-90b3-68e0a96372a9 tempest-TaggedBootDevicesTest-889601151 None] Lock "cinder-608fb9a6-c1a3-400c-80f7-69dc4edfaf41-delete_volume" released by "delete_volume" :: held 4.374s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:25:54 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=21,cinder:UPDATE=27,cinder:DELETE=1,cinder:INSERT=8 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:25:54 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=22,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=4 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:26:01 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-c8dbc6e6-cc3a-4d04-a609-4745c4524c58 req-00c99eb9-5b43-44a0-99df-00edb6f1abfd tempest-DeleteServersTestJSON-178307861 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:26:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-c8dbc6e6-cc3a-4d04-a609-4745c4524c58 req-00c99eb9-5b43-44a0-99df-00edb6f1abfd tempest-DeleteServersTestJSON-178307861 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:26:02 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-c8dbc6e6-cc3a-4d04-a609-4745c4524c58 req-00c99eb9-5b43-44a0-99df-00edb6f1abfd tempest-DeleteServersTestJSON-178307861 None] Terminate volume connection completed successfully.
Sep 18 13:26:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c8dbc6e6-cc3a-4d04-a609-4745c4524c58 req-00c99eb9-5b43-44a0-99df-00edb6f1abfd tempest-DeleteServersTestJSON-178307861 None] Deleting attachment 1f8e935b-dbf7-4db6-929b-ca7cd8189829. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:26:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Acquiring lock "cinder-78117104-ca4a-4589-a9d1-f445ecbda465-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:26:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Lock "cinder-78117104-ca4a-4589-a9d1-f445ecbda465-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:26:10 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:26:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Acquiring lock "cinder-quobyte-78117104-ca4a-4589-a9d1-f445ecbda465" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:26:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Lock "cinder-quobyte-78117104-ca4a-4589-a9d1-f445ecbda465" acquired by "delete_volume" :: waited 0.034s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:26:10 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e833e0f2-8efe-4a8e-bff7-e5d5d204c683]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:26:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:26:12 devstack quobyte-client[82822]: System call of process 86703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:26:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:26:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:26:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:26:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:26:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:26:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:26:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:26:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465" returned: 0 in 1.815s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:26:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:26:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.521s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:26:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:26:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78117104-ca4a-4589-a9d1-f445ecbda465" returned: 0 in 0.367s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:26:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Lock "cinder-quobyte-78117104-ca4a-4589-a9d1-f445ecbda465" released by "delete_volume" :: held 2.550s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:26:13 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Created reservations ['e00fc327-dc80-40f1-b1ce-de60e4da3953', 'b1469c40-688c-4f4b-a50d-1a5a01482568', '2673ae3d-033a-45a3-8549-48e1057e0611', 'ad67bf21-0def-4172-806a-1b2279d679f5'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:26:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:26:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:26:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:26:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:26:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:26:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:26:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.150s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:26:14 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:26:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Deleted volume successfully.
Sep 18 13:26:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9398ed4d-0914-41f5-80c9-65d22697a753 tempest-DeleteServersTestJSON-178307861 None] Lock "cinder-78117104-ca4a-4589-a9d1-f445ecbda465-delete_volume" released by "delete_volume" :: held 5.150s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:26:21 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Flow 'volume_create_manager' (be71ff8d-8701-4abe-80f9-f2bf27cdc896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6dc8ab7-921e-4924-8b19-ef3a93b60a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6dc8ab7-921e-4924-8b19-ef3a93b60a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-607476168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f63607-9ba8-40a9-ac93-d1555a511606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c54eaacc0ba4bdf8375fda1db802aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:26:21Z,use_quota=True,user_id='2e764bf1d17f4b3584601ba7f14e74cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d5c75-ffba-487c-a60e-58d7958fe85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d5c75-ffba-487c-a60e-58d7958fe85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be0554d-3f5e-4c9d-808b-27affae61178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be0554d-3f5e-4c9d-808b-27affae61178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f63607-9ba8-40a9-ac93-d1555a511606', 'volume_name': 'volume-57f63607-9ba8-40a9-ac93-d1555a511606', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052886a0-cbed-4384-b2f5-3bc682b31366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052886a0-cbed-4384-b2f5-3bc682b31366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a666684f-b4c7-4a9a-a8a2-b602a1201661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:26:21 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Volume 57f63607-9ba8-40a9-ac93-d1555a511606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f63607-9ba8-40a9-ac93-d1555a511606', 'volume_size': 1}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-607476168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f63607-9ba8-40a9-ac93-d1555a511606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c54eaacc0ba4bdf8375fda1db802aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:26:21Z,use_quota=True,user_id='2e764bf1d17f4b3584601ba7f14e74cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Creating volume 57f63607-9ba8-40a9-ac93-d1555a511606 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:26:21 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:26:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57f63607-9ba8-40a9-ac93-d1555a511606 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:26:22 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=8, name=volume-57f63607-9ba8-40a9-ac93-d1555a511606, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:26:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57f63607-9ba8-40a9-ac93-d1555a511606 1073741824" returned: 0 in 0.744s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:26:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57f63607-9ba8-40a9-ac93-d1555a511606 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:26:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57f63607-9ba8-40a9-ac93-d1555a511606" returned: 0 in 0.194s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:26:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] <== create_volume: return (1087ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:26:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:26:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a666684f-b4c7-4a9a-a8a2-b602a1201661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f63607-9ba8-40a9-ac93-d1555a511606', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:26:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72cca0d-b5c6-4011-9905-e936f6723f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:26:23 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Volume volume-57f63607-9ba8-40a9-ac93-d1555a511606 (57f63607-9ba8-40a9-ac93-d1555a511606): created successfully
Sep 18 13:26:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72cca0d-b5c6-4011-9905-e936f6723f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:26:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Flow 'volume_create_manager' (be71ff8d-8701-4abe-80f9-f2bf27cdc896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:26:23 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-d574c160-70d5-479c-9aac-aa682cc637d0 tempest-VolumesAdminNegativeTest-1295300105 None] Created volume successfully.
Sep 18 13:26:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Acquiring lock "cinder-57f63607-9ba8-40a9-ac93-d1555a511606-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:26:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "cinder-57f63607-9ba8-40a9-ac93-d1555a511606-delete_volume" acquired by "delete_volume" :: waited 0.191s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:26:26 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:26:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Acquiring lock "cinder-quobyte-57f63607-9ba8-40a9-ac93-d1555a511606" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:26:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "cinder-quobyte-57f63607-9ba8-40a9-ac93-d1555a511606" acquired by "delete_volume" :: waited 0.053s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:26:26 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0a9f66-a12f-48de-beb6-dfeda9ac0bba]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:26:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57f63607-9ba8-40a9-ac93-d1555a511606 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:26:27 devstack quobyte-client[82822]: System call of process 86735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:26:27 devstack quobyte-client[82822]: System call of process 86735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:26:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57f63607-9ba8-40a9-ac93-d1555a511606" returned: 0 in 0.829s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:26:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57f63607-9ba8-40a9-ac93-d1555a511606 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:26:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57f63607-9ba8-40a9-ac93-d1555a511606" returned: 0 in 0.224s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:26:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "cinder-quobyte-57f63607-9ba8-40a9-ac93-d1555a511606" released by "delete_volume" :: held 1.540s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Created reservations ['33780834-27bd-4cb0-8e04-de0f84c33462', '22d5f798-12aa-4f80-96d2-b96f239beb13', 'b9483380-5a13-4317-80f6-ba6d70cf240d', '9f0a95ae-caa3-4a3b-89ab-ee2b321e4158'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.230s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:26:28 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Deleted volume successfully.
Sep 18 13:26:28 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d4e499fa-9e89-4c7d-8e7f-5572c75f4819 tempest-VolumesAdminNegativeTest-1295300105 None] Lock "cinder-57f63607-9ba8-40a9-ac93-d1555a511606-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:26:38 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=6 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:26:38 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=9,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:27:10 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Flow 'volume_create_manager' (01dcfa9c-766b-44be-9998-f50d7fa02044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ea5b95-b1e8-4ae4-a932-8fec554b8298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ea5b95-b1e8-4ae4-a932-8fec554b8298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1043314616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7e8817-39ed-4b60-9315-1f351c38d962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c9bdaaed24466d8bb88267b2a22d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:27:10Z,use_quota=True,user_id='cbca643e743443b49abe26c4aa005623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499be7b0-3d1f-4354-aa2e-c92dee5c5d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499be7b0-3d1f-4354-aa2e-c92dee5c5d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872bf2c4-2634-434c-93c9-5e7887a97432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872bf2c4-2634-434c-93c9-5e7887a97432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa7e8817-39ed-4b60-9315-1f351c38d962', 'volume_name': 'volume-fa7e8817-39ed-4b60-9315-1f351c38d962', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5481ab6d-5e98-4062-97f5-ca6f5fd6c474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5481ab6d-5e98-4062-97f5-ca6f5fd6c474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3753570d-6c4c-45a9-81c3-758bca396d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:10 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Volume fa7e8817-39ed-4b60-9315-1f351c38d962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa7e8817-39ed-4b60-9315-1f351c38d962', 'volume_size': 1}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1043314616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7e8817-39ed-4b60-9315-1f351c38d962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c9bdaaed24466d8bb88267b2a22d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:27:10Z,use_quota=True,user_id='cbca643e743443b49abe26c4aa005623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Creating volume fa7e8817-39ed-4b60-9315-1f351c38d962 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:27:10 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:27:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:27:10 devstack quobyte-client[82822]: System call of process 86852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:27:10 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=9, name=volume-fa7e8817-39ed-4b60-9315-1f351c38d962, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:27:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962 1073741824" returned: 0 in 0.957s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:27:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:27:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962" returned: 0 in 0.292s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:27:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] <== create_volume: return (1424ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:27:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:27:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3753570d-6c4c-45a9-81c3-758bca396d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7e8817-39ed-4b60-9315-1f351c38d962', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ec4b58-39f4-40ba-b18b-4845cd6a4ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:12 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Volume volume-fa7e8817-39ed-4b60-9315-1f351c38d962 (fa7e8817-39ed-4b60-9315-1f351c38d962): created successfully
Sep 18 13:27:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ec4b58-39f4-40ba-b18b-4845cd6a4ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Flow 'volume_create_manager' (01dcfa9c-766b-44be-9998-f50d7fa02044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:27:12 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-5b9ba0b6-6103-4bbb-85e5-975d0b435e0b tempest-TaggedAttachmentsTest-1916704525 None] Created volume successfully.
Sep 18 13:27:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:27:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:27:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c68dd4a9-806b-4ae0-b59b-19682e414b92 tempest-BackendsCapabilitiesAdminTestsJSON-381641472 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82799) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 18 13:27:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-370ddb8f-de33-4c79-96d9-0037dc93b64e tempest-BackendsCapabilitiesAdminTestsJSON-381641472 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82799) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 18 13:27:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7ebe67c9-77f7-4cd5-8e15-2f0986b44c3c tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:27:47 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7ebe67c9-77f7-4cd5-8e15-2f0986b44c3c tempest-GroupSnapshotsTest-832653071 None] Group tempest-GroupSnapshotsTest-Group-1398813166: creating
Sep 18 13:27:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7ebe67c9-77f7-4cd5-8e15-2f0986b44c3c tempest-GroupSnapshotsTest-832653071 None] Group tempest-GroupSnapshotsTest-Group-1398813166: created successfully
Sep 18 13:27:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7ebe67c9-77f7-4cd5-8e15-2f0986b44c3c tempest-GroupSnapshotsTest-832653071 None] Create group completed successfully.
Sep 18 13:27:49 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:27:49 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:27:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Flow 'volume_create_manager' (baa06233-abad-431b-8c0f-03a579e1955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:27:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faad7a69-c7f4-4be5-93a6-6aeed0be983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faad7a69-c7f4-4be5-93a6-6aeed0be983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023322837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8d0dd302-307b-4776-bcc0-a527d8e27276,host='devstack@QuobyteHD#QuobyteHD',id=7d9e71f1-2537-4e7c-9832-1e48043f1119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d642a107b0d44388bfaf662db35f863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:27:50Z,use_quota=True,user_id='4d3be15a40c64caf974ae9f0c9a8ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8770ccfc-1401-46c5-a3f8-66630757b870),volume_type_id=8770ccfc-1401-46c5-a3f8-66630757b870)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4408ef67-c51f-49e8-9732-4c0fcc1344f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4408ef67-c51f-49e8-9732-4c0fcc1344f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfbb085-8c03-4a16-8e35-40da9a73f41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfbb085-8c03-4a16-8e35-40da9a73f41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9e71f1-2537-4e7c-9832-1e48043f1119', 'volume_name': 'volume-7d9e71f1-2537-4e7c-9832-1e48043f1119', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe6e48d-15f9-4d10-b5c1-e99aded49dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe6e48d-15f9-4d10-b5c1-e99aded49dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa659e3e-55ca-4198-af3c-05d7a720528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:50 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Volume 7d9e71f1-2537-4e7c-9832-1e48043f1119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9e71f1-2537-4e7c-9832-1e48043f1119', 'volume_size': 1}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8d0dd302-307b-4776-bcc0-a527d8e27276,created_at=2025-09-18T11:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023322837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8d0dd302-307b-4776-bcc0-a527d8e27276,host='devstack@QuobyteHD#QuobyteHD',id=7d9e71f1-2537-4e7c-9832-1e48043f1119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d642a107b0d44388bfaf662db35f863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:27:50Z,use_quota=True,user_id='4d3be15a40c64caf974ae9f0c9a8ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8770ccfc-1401-46c5-a3f8-66630757b870),volume_type_id=8770ccfc-1401-46c5-a3f8-66630757b870)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Creating volume 7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:27:50 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:27:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:27:50 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=10, name=volume-7d9e71f1-2537-4e7c-9832-1e48043f1119, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:27:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 1073741824" returned: 0 in 0.932s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:27:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:27:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119" returned: 0 in 0.126s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:27:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] <== create_volume: return (1250ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:27:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:27:51 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa659e3e-55ca-4198-af3c-05d7a720528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9e71f1-2537-4e7c-9832-1e48043f1119', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:51 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7b8dd5-bafd-439b-9e69-e7c6162a7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:27:51 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Volume volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 (7d9e71f1-2537-4e7c-9832-1e48043f1119): created successfully
Sep 18 13:27:51 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7b8dd5-bafd-439b-9e69-e7c6162a7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:27:51 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Flow 'volume_create_manager' (baa06233-abad-431b-8c0f-03a579e1955b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:27:51 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ef6b553e-98b1-4d8a-9c20-3eb931235614 tempest-GroupSnapshotsTest-832653071 None] Created volume successfully.
Sep 18 13:27:55 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] GroupSnapshot 1034b3ca-2fbb-4f4e-ac4e-778c9f3a0003: creating.
Sep 18 13:27:56 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:27:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Group snapshot 1034b3ca-2fbb-4f4e-ac4e-778c9f3a0003: creating. {{(pid=82799) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 13:27:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:27:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:27:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Creating offline snapshot 2c406c04-fa76-49ff-856e-85b1faaed3a5 of volume 7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:27:57 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0972a6b5-88e6-4345-8c0a-a8874ba7014c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:27:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:27:59 devstack quobyte-client[82822]: System call of process 87136 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119" returned: 0 in 3.014s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:00 devstack quobyte-client[82822]: System call of process 87162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:00 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=11, name=volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:28:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 1G" returned: 0 in 1.290s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img rebase -u -b volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5" returned: 0 in 0.663s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:28:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5" returned: 0 in 0.292s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:28:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5" returned: 0 in 0.271s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.info" returned: 0 in 0.560s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:28:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.info" returned: 0 in 0.253s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.700s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:06 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:28:08 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b82bb4c3-bc16-4e1b-aed1-026304b464d0 tempest-GroupSnapshotsTest-832653071 None] group_snapshot 1034b3ca-2fbb-4f4e-ac4e-778c9f3a0003: created successfully
Sep 18 13:28:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:28:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:28:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:28:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:28:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:28:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:14 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 1.894s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-2c406c04-fa76-49ff-856e-85b1faaed3a5-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" by "_create_volume_from_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-2c406c04-fa76-49ff-856e-85b1faaed3a5-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" acquired by "_create_volume_from_snapshot" :: waited 0.299s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Creating volume d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc from snapshot 2c406c04-fa76-49ff-856e-85b1faaed3a5 {{(pid=82799) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" by "_copy_volume_from_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] snapshot: 2c406c04-fa76-49ff-856e-85b1faaed3a5, volume: d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc,  {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:28:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:15 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd0eb32-9132-486a-89b7-ba3a392572fe]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:28:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5" returned: 0 in 2.828s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9e71f1-2537-4e7c-9832-1e48043f1119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:28:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] will copy from snapshot at /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 13:28:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Creating direct copy from snapshot {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 13:28:18 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[493fc43c-97d8-47bc-9c55-48337b1512bf]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:28:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:19 devstack quobyte-client[82822]: System call of process 87267 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119" returned: 0 in 1.623s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:20 devstack cinder-volume[82799]: DEBUG cinder.utils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc not found in is_blk_device check {{(pid=82799) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 13:28:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:20 devstack quobyte-client[82822]: System call of process 87278 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:20 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=13, name=volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:28:24 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:28:25 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:28:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" returned: 0 in 24.133s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:44 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9376675-7f8c-47f8-a41a-cc225ffd1de4]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:28:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:45 devstack quobyte-client[82822]: System call of process 87355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119" returned: 0 in 2.479s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:46 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Image conversion details: src /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119, size 1024.00 MB, duration 24.18 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:28:46 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Converted 1024.00 MB image at 42.35 MB/s
Sep 18 13:28:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:28:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Flow 'volume_create_manager' (839c8e45-f53a-4c57-b93a-d4766d7567d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719e5d93-04f8-4fb0-96b4-bf6ca104f878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719e5d93-04f8-4fb0-96b4-bf6ca104f878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1173399389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4954271b-e9be-4b84-85c9-62137e0788e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e73e6596db54c858b830ad3ef05acc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:28:46Z,use_quota=True,user_id='29a64781958b4e448cd0f9720f2bcc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0914bd6c-84b4-48c3-bfbc-d99e6a221899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0914bd6c-84b4-48c3-bfbc-d99e6a221899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9269978b-a5de-45ed-ae63-45dc4ca3f820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9269978b-a5de-45ed-ae63-45dc4ca3f820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4954271b-e9be-4b84-85c9-62137e0788e6', 'volume_name': 'volume-4954271b-e9be-4b84-85c9-62137e0788e6', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330279dd-8657-4d67-9ef4-ac8e91688aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330279dd-8657-4d67-9ef4-ac8e91688aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41496a29-d28d-40d7-ae9f-3922ef05e2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:47 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Volume 4954271b-e9be-4b84-85c9-62137e0788e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4954271b-e9be-4b84-85c9-62137e0788e6', 'volume_size': 1}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" returned: 0 in 0.999s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" released by "_copy_volume_from_snapshot" :: held 33.113s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-2c406c04-fa76-49ff-856e-85b1faaed3a5-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" released by "_create_volume_from_snapshot" :: held 33.199s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:28:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 33.540s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.104s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1173399389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4954271b-e9be-4b84-85c9-62137e0788e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e73e6596db54c858b830ad3ef05acc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:28:46Z,use_quota=True,user_id='29a64781958b4e448cd0f9720f2bcc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Creating volume 4954271b-e9be-4b84-85c9-62137e0788e6 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:28:48 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4954271b-e9be-4b84-85c9-62137e0788e6 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:48 devstack quobyte-client[82822]: System call of process 87397 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:48 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=14, name=volume-4954271b-e9be-4b84-85c9-62137e0788e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4954271b-e9be-4b84-85c9-62137e0788e6 1073741824" returned: 0 in 0.700s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4954271b-e9be-4b84-85c9-62137e0788e6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4954271b-e9be-4b84-85c9-62137e0788e6" returned: 0 in 0.551s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] <== create_volume: return (1330ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:28:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:49 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-14329169-1443-46d5-b341-38737f8c41ed tempest-GroupSnapshotsTest-832653071 None] Create group from source-snapshot-1034b3ca-2fbb-4f4e-ac4e-778c9f3a0003 completed successfully.
Sep 18 13:28:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41496a29-d28d-40d7-ae9f-3922ef05e2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4954271b-e9be-4b84-85c9-62137e0788e6', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c549aa89-8738-492e-86fd-ab7e0f841ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:49 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Volume volume-4954271b-e9be-4b84-85c9-62137e0788e6 (4954271b-e9be-4b84-85c9-62137e0788e6): created successfully
Sep 18 13:28:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c549aa89-8738-492e-86fd-ab7e0f841ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Flow 'volume_create_manager' (839c8e45-f53a-4c57-b93a-d4766d7567d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:28:49 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b2f60f52-b135-44d0-9c15-70274c6fc824 tempest-ServersNegativeTestJSON-752973274 None] Created volume successfully.
Sep 18 13:28:50 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:28:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:28:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" acquired by "delete_volume" :: waited 0.105s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:28:50 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ddb36f-6ee8-40af-b1e7-195e248e5485]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:28:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:51 devstack quobyte-client[82822]: System call of process 87402 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" returned: 0 in 0.970s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" returned: 0 in 0.209s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-d3ff4f8f-bbbd-4d6f-9a53-11321dabf1fc" released by "delete_volume" :: held 1.585s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:28:52 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Created reservations ['0f53f6c3-573c-4595-922b-0a5ccb862de1'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:28:52 devstack cinder-volume[82799]: WARNING cinder.quota [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1075489730 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1075489730, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:28:52 devstack cinder-volume[82799]: WARNING cinder.quota [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1075489730 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1075489730, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:28:52 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Created reservations ['62d07407-bfde-4a7f-b825-f660e5cb3b2a', '13f6c524-ed8d-4ce0-b7b5-5f151f45fd7d', 'a8bb4556-086d-4653-8c08-54ca87f6acb6', '578947d1-aec7-4a51-a45c-353003728e54'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:28:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:28:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:28:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:28:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:28:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.158s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:53 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:28:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ac10701a-5767-4360-bfc8-4e0629830ecd tempest-GroupSnapshotsTest-832653071 None] Delete group completed successfully.
Sep 18 13:28:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] group_snapshot 1034b3ca-2fbb-4f4e-ac4e-778c9f3a0003: deleting
Sep 18 13:28:54 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] group_snapshot 1034b3ca-2fbb-4f4e-ac4e-778c9f3a0003: deleting {{(pid=82799) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 13:28:54 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Flow 'volume_create_manager' (d9425871-a057-4955-94c5-d4df14fa9fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a29429e-b7a1-4f6b-bd84-435b84e36edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a29429e-b7a1-4f6b-bd84-435b84e36edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1306934988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325dcf8d-9070-49f2-b33c-90b18cc45fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e73e6596db54c858b830ad3ef05acc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:28:54Z,use_quota=True,user_id='29a64781958b4e448cd0f9720f2bcc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517c892a-37a0-4ba9-8c5a-77639e0f4a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517c892a-37a0-4ba9-8c5a-77639e0f4a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30ee73c-5d9a-4c4c-b38b-44bb7ee6d1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30ee73c-5d9a-4c4c-b38b-44bb7ee6d1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325dcf8d-9070-49f2-b33c-90b18cc45fd5', 'volume_name': 'volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e95cb2a-756b-4de0-a70a-406272c93285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e95cb2a-756b-4de0-a70a-406272c93285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd319a88-95ca-461b-9fa9-77c23b147c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:54 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Volume 325dcf8d-9070-49f2-b33c-90b18cc45fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5', 'volume_size': 1}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1306934988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325dcf8d-9070-49f2-b33c-90b18cc45fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e73e6596db54c858b830ad3ef05acc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:28:54Z,use_quota=True,user_id='29a64781958b4e448cd0f9720f2bcc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Creating volume 325dcf8d-9070-49f2-b33c-90b18cc45fd5 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:28:54 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:28:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:55 devstack quobyte-client[82822]: System call of process 87407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:55 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=15, name=volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-7d9e71f1-2537-4e7c-9832-1e48043f1119" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-7d9e71f1-2537-4e7c-9832-1e48043f1119" acquired by "delete_snapshot" :: waited 0.207s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-2c406c04-fa76-49ff-856e-85b1faaed3a5" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-2c406c04-fa76-49ff-856e-85b1faaed3a5" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Deleting offline snapshot 2c406c04-fa76-49ff-856e-85b1faaed3a5 of volume 7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] snapshot_file for this snap is: volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5 1073741824" returned: 0 in 0.675s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de65aee-b313-49c7-9247-6738d52e009d]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5" returned: 0 in 0.200s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] <== create_volume: return (926ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:28:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:28:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd319a88-95ca-461b-9fa9-77c23b147c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971682d6-5202-466f-aa9e-cf5cf5223d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:28:56 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Volume volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5 (325dcf8d-9070-49f2-b33c-90b18cc45fd5): created successfully
Sep 18 13:28:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971682d6-5202-466f-aa9e-cf5cf5223d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:28:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Flow 'volume_create_manager' (d9425871-a057-4955-94c5-d4df14fa9fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:28:56 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-2b98ff38-626a-4c25-8ea0-b266dee2920a tempest-ServersNegativeTestJSON-752973274 None] Created volume successfully.
Sep 18 13:28:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5" returned: 0 in 0.598s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9e71f1-2537-4e7c-9832-1e48043f1119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:28:56 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc783b6-9f74-4d7c-bd28-d5c609ada804]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:28:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119" returned: 0 in 0.745s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:57 devstack quobyte-client[82822]: System call of process 87424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5" returned: 0 in 0.306s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "cinder-325dcf8d-9070-49f2-b33c-90b18cc45fd5-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:28:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119.2c406c04-fa76-49ff-856e-85b1faaed3a5" returned: 0 in 0.336s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-2c406c04-fa76-49ff-856e-85b1faaed3a5" released by "_delete_snapshot" :: held 2.336s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:28:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Lock "cinder-325dcf8d-9070-49f2-b33c-90b18cc45fd5-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:28:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-7d9e71f1-2537-4e7c-9832-1e48043f1119" released by "delete_snapshot" :: held 2.488s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:28:58 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:28:58 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "cinder-quobyte-325dcf8d-9070-49f2-b33c-90b18cc45fd5" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:28:58 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Lock "cinder-quobyte-325dcf8d-9070-49f2-b33c-90b18cc45fd5" acquired by "delete_volume" :: waited 0.057s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:28:58 devstack cinder-volume[82799]: WARNING cinder.quota [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1075489730 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1075489730, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:28:58 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cb0939-0100-4069-ad94-22d4f6b32cc0]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:28:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:58 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['f695f0d2-5c97-436d-b8d0-5fb81ecd26f0', 'dfa2507f-3c7b-43a3-99f4-e7b2f22c270b', 'fa090eca-c17c-4e44-8368-59861c1e5a67', '248eaeda-f22f-4962-ad47-6050dc21a667'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:28:59 devstack quobyte-client[82822]: System call of process 87428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:28:59 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-210346ab-9af5-4504-bea4-25abba980f28 tempest-GroupSnapshotsTest-832653071 None] group_snapshot 1034b3ca-2fbb-4f4e-ac4e-778c9f3a0003: deleted successfully
Sep 18 13:28:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5" returned: 0 in 1.031s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:28:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-325dcf8d-9070-49f2-b33c-90b18cc45fd5" returned: 0 in 0.132s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:28:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Lock "cinder-quobyte-325dcf8d-9070-49f2-b33c-90b18cc45fd5" released by "delete_volume" :: held 1.348s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:28:59 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Created reservations ['a1a94ee5-8da4-4931-82bb-7b06073165a4', 'ed6bd908-a85a-4ada-ba1b-a8658492d4cf', '8e25b3f1-110d-4da7-8672-4b1979206db4', '94a80adf-0054-4e12-9ce7-95297389c72a'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:29:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:29:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.569s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:00 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:29:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:00 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Deleted volume successfully.
Sep 18 13:29:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-7d9e71f1-2537-4e7c-9832-1e48043f1119" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8fc5da6c-1968-46ab-a8c1-7c7a07ca2c5b tempest-ServersNegativeTestJSON-752973274 None] Lock "cinder-325dcf8d-9070-49f2-b33c-90b18cc45fd5-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-7d9e71f1-2537-4e7c-9832-1e48043f1119" acquired by "delete_volume" :: waited 0.109s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:01 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[875dd2ba-4c88-40bf-9989-6f62b3dfcf4f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "cinder-4954271b-e9be-4b84-85c9-62137e0788e6-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Lock "cinder-4954271b-e9be-4b84-85c9-62137e0788e6-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:01 devstack quobyte-client[82822]: System call of process 87433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:01 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "cinder-quobyte-4954271b-e9be-4b84-85c9-62137e0788e6" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119" returned: 0 in 0.823s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7d9e71f1-2537-4e7c-9832-1e48043f1119" returned: 0 in 0.155s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Lock "cinder-quobyte-4954271b-e9be-4b84-85c9-62137e0788e6" acquired by "delete_volume" :: waited 0.213s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:02 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab104834-330f-4931-b69e-084d48f14efe]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4954271b-e9be-4b84-85c9-62137e0788e6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-7d9e71f1-2537-4e7c-9832-1e48043f1119" released by "delete_volume" :: held 1.233s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:02 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['69331f5a-6dda-4dbc-af16-d6621cac7bd0'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:02 devstack cinder-volume[82799]: WARNING cinder.db.sqlalchemy.api [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1075489730']
Sep 18 13:29:02 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['8d66058f-3f64-4125-a3ac-613a814c3d98', 'fa695c58-790a-4bca-a6d8-88d348d22c26', 'fe4755e7-b376-451b-a72c-8f607f478d3b', '5be3aace-7e94-4d6c-8051-b6a88f555208'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:02 devstack quobyte-client[82822]: System call of process 87437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4954271b-e9be-4b84-85c9-62137e0788e6" returned: 0 in 0.809s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4954271b-e9be-4b84-85c9-62137e0788e6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4954271b-e9be-4b84-85c9-62137e0788e6" returned: 0 in 0.289s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Lock "cinder-quobyte-4954271b-e9be-4b84-85c9-62137e0788e6" released by "delete_volume" :: held 1.285s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.234s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:29:03 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b23e0815-2add-4074-8215-960bcaf007d9 tempest-GroupSnapshotsTest-832653071 None] Delete group completed successfully.
Sep 18 13:29:03 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Created reservations ['2967df14-ca07-4e71-a144-27017f3f7b7f', 'f4f7d615-f61f-47fb-9a9b-6bf896ea7517', '4da4bdcc-545a-4565-bfd5-9f1698dac9b1', 'f2b14f85-d3c1-4bba-905f-06fb81e020ab'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:29:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:29:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.121s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:04 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:29:04 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Deleted volume successfully.
Sep 18 13:29:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e5fa79a6-ec8f-425f-9121-a5f7acbea84c tempest-ServersNegativeTestJSON-752973274 None] Lock "cinder-4954271b-e9be-4b84-85c9-62137e0788e6-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ceaec7e9-b55b-473d-9f7e-a029172389d1 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:05 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ceaec7e9-b55b-473d-9f7e-a029172389d1 tempest-GroupSnapshotsTest-832653071 None] Group tempest-GroupSnapshotsTest-Group-236944396: creating
Sep 18 13:29:05 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ceaec7e9-b55b-473d-9f7e-a029172389d1 tempest-GroupSnapshotsTest-832653071 None] Group tempest-GroupSnapshotsTest-Group-236944396: created successfully
Sep 18 13:29:05 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ceaec7e9-b55b-473d-9f7e-a029172389d1 tempest-GroupSnapshotsTest-832653071 None] Create group completed successfully.
Sep 18 13:29:08 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Flow 'volume_create_manager' (04f76d67-5c65-458f-96b2-b9c2f7af13c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329dc567-a259-49b4-81d7-bb2a7394b53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329dc567-a259-49b4-81d7-bb2a7394b53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1071284218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=24fe499f-0938-4ef8-893a-aa5a981063e7,host='devstack@QuobyteHD#QuobyteHD',id=b1e02df8-a95e-4ac0-a6d6-3a09a017f21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d642a107b0d44388bfaf662db35f863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:29:08Z,use_quota=True,user_id='4d3be15a40c64caf974ae9f0c9a8ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93069777-294f-453d-815c-43bbd05b25bd),volume_type_id=93069777-294f-453d-815c-43bbd05b25bd)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876278c0-9ada-4319-bbfc-26bce08a9087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876278c0-9ada-4319-bbfc-26bce08a9087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce7bb6b-30db-41f5-a17e-c86439fe0abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce7bb6b-30db-41f5-a17e-c86439fe0abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e02df8-a95e-4ac0-a6d6-3a09a017f21a', 'volume_name': 'volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c5d807-2943-47f8-a1d7-b1a6c15580d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c5d807-2943-47f8-a1d7-b1a6c15580d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf78563-f7bb-490e-a41a-2c0c4bff1881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:08 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Volume b1e02df8-a95e-4ac0-a6d6-3a09a017f21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a', 'volume_size': 1}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=24fe499f-0938-4ef8-893a-aa5a981063e7,created_at=2025-09-18T11:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1071284218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=24fe499f-0938-4ef8-893a-aa5a981063e7,host='devstack@QuobyteHD#QuobyteHD',id=b1e02df8-a95e-4ac0-a6d6-3a09a017f21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d642a107b0d44388bfaf662db35f863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:29:08Z,use_quota=True,user_id='4d3be15a40c64caf974ae9f0c9a8ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93069777-294f-453d-815c-43bbd05b25bd),volume_type_id=93069777-294f-453d-815c-43bbd05b25bd)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Creating volume b1e02df8-a95e-4ac0-a6d6-3a09a017f21a {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:29:08 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:29:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:08 devstack quobyte-client[82822]: System call of process 87510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:08 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=16, name=volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:29:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a 1073741824" returned: 0 in 0.625s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" returned: 0 in 0.169s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] <== create_volume: return (891ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:29:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf78563-f7bb-490e-a41a-2c0c4bff1881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b177607-2c22-4203-874d-ec9511f9afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:09 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Volume volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a (b1e02df8-a95e-4ac0-a6d6-3a09a017f21a): created successfully
Sep 18 13:29:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b177607-2c22-4203-874d-ec9511f9afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Flow 'volume_create_manager' (04f76d67-5c65-458f-96b2-b9c2f7af13c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:29:09 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c08f5fc3-6d33-437d-8f69-0cb937d95686 tempest-GroupSnapshotsTest-832653071 None] Created volume successfully.
Sep 18 13:29:11 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Flow 'volume_create_manager' (841c74de-e84c-47e7-b57e-09353b7d891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15dd36c4-aab1-491b-a02a-cc6e27e3197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15dd36c4-aab1-491b-a02a-cc6e27e3197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-879998230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=24fe499f-0938-4ef8-893a-aa5a981063e7,host='devstack@QuobyteHD#QuobyteHD',id=0927929f-0751-4b63-94df-f6a08227f3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d642a107b0d44388bfaf662db35f863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:29:11Z,use_quota=True,user_id='4d3be15a40c64caf974ae9f0c9a8ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93069777-294f-453d-815c-43bbd05b25bd),volume_type_id=93069777-294f-453d-815c-43bbd05b25bd)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9c9fcc-dc3a-48a5-af81-090a10921cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9c9fcc-dc3a-48a5-af81-090a10921cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540d7884-2564-4421-8c58-610941d19476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540d7884-2564-4421-8c58-610941d19476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0927929f-0751-4b63-94df-f6a08227f3bf', 'volume_name': 'volume-0927929f-0751-4b63-94df-f6a08227f3bf', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744065ff-16f2-45a4-9a2b-845005b64013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744065ff-16f2-45a4-9a2b-845005b64013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729fbbb9-a20f-4351-9ffa-fc90590886e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Volume 0927929f-0751-4b63-94df-f6a08227f3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0927929f-0751-4b63-94df-f6a08227f3bf', 'volume_size': 1}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=24fe499f-0938-4ef8-893a-aa5a981063e7,created_at=2025-09-18T11:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-879998230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=24fe499f-0938-4ef8-893a-aa5a981063e7,host='devstack@QuobyteHD#QuobyteHD',id=0927929f-0751-4b63-94df-f6a08227f3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d642a107b0d44388bfaf662db35f863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:29:11Z,use_quota=True,user_id='4d3be15a40c64caf974ae9f0c9a8ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93069777-294f-453d-815c-43bbd05b25bd),volume_type_id=93069777-294f-453d-815c-43bbd05b25bd)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Creating volume 0927929f-0751-4b63-94df-f6a08227f3bf {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:29:11 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:11 devstack quobyte-client[82822]: System call of process 87519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:11 devstack quobyte-client[82822]: System call of process 87519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:11 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=17, name=volume-0927929f-0751-4b63-94df-f6a08227f3bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf 1073741824" returned: 0 in 0.344s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf" returned: 0 in 0.099s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] <== create_volume: return (514ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:29:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.527s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729fbbb9-a20f-4351-9ffa-fc90590886e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0927929f-0751-4b63-94df-f6a08227f3bf', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b273843-907f-46b3-bf89-6e8e6855737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:12 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Volume volume-0927929f-0751-4b63-94df-f6a08227f3bf (0927929f-0751-4b63-94df-f6a08227f3bf): created successfully
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b273843-907f-46b3-bf89-6e8e6855737f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Flow 'volume_create_manager' (841c74de-e84c-47e7-b57e-09353b7d891e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:29:12 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-cc12c0eb-381c-4229-bad9-aa9297882288 tempest-GroupSnapshotsTest-832653071 None] Created volume successfully.
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.227s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:29:12 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-40870623-5bd9-4ae7-ae63-625542d3e087 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:12 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-40870623-5bd9-4ae7-ae63-625542d3e087 tempest-GroupSnapshotsTest-832653071 None] Update group completed successfully.
Sep 18 13:29:13 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-37267990-329c-4f2f-ad37-c40acdff46ed tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:13 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-37267990-329c-4f2f-ad37-c40acdff46ed tempest-GroupSnapshotsTest-832653071 None] Update group completed successfully.
Sep 18 13:29:14 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7263081b-e151-4351-9b25-f25882dc5368 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7263081b-e151-4351-9b25-f25882dc5368 tempest-GroupSnapshotsTest-832653071 None] Update group completed successfully.
Sep 18 13:29:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e9144b20-c02f-4c3f-9f36-db747e64ad7e tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e9144b20-c02f-4c3f-9f36-db747e64ad7e tempest-GroupSnapshotsTest-832653071 None] Update group completed successfully.
Sep 18 13:29:18 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] GroupSnapshot 28a0301d-257b-4a59-aad9-d05040d3ec68: creating.
Sep 18 13:29:18 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Group snapshot 28a0301d-257b-4a59-aad9-d05040d3ec68: creating. {{(pid=82799) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 13:29:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Creating offline snapshot 07efea02-0341-458d-8a40-d5197e65dc32 of volume 0927929f-0751-4b63-94df-f6a08227f3bf {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:29:18 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed87774a-d9bb-4db0-bd18-6cf69aa69321]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:18 devstack quobyte-client[82822]: System call of process 87528 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf" returned: 0 in 0.872s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:19 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=18, name=volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:29:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 1G" returned: 0 in 0.453s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0927929f-0751-4b63-94df-f6a08227f3bf -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:20 devstack quobyte-client[82822]: System call of process 87539 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img rebase -u -b volume-0927929f-0751-4b63-94df-f6a08227f3bf -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32" returned: 0 in 0.625s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:29:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32" returned: 0 in 0.210s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:29:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32" returned: 0 in 0.377s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.info" returned: 0 in 0.195s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:29:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.info" returned: 0 in 0.176s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.625s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Creating offline snapshot 695dc121-7204-45bb-b4ab-b52c6ecd5eab of volume b1e02df8-a95e-4ac0-a6d6-3a09a017f21a {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:29:22 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e7e06-9fe7-4eca-95b2-e039e72e28ee]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" returned: 0 in 0.843s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:23 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=20, name=volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:29:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab 1G" returned: 0 in 0.581s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:23 devstack quobyte-client[82822]: System call of process 87556 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img rebase -u -b volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab" returned: 0 in 0.270s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:23 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:29:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab" returned: 0 in 0.124s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab" returned: 0 in 0.186s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.info" returned: 0 in 0.123s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.info" returned: 0 in 0.185s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.198s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:25 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-90bba71a-7c68-4633-98a4-f3b2c7026c93 tempest-GroupSnapshotsTest-832653071 None] group_snapshot 28a0301d-257b-4a59-aad9-d05040d3ec68: created successfully
Sep 18 13:29:26 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] group_snapshot 28a0301d-257b-4a59-aad9-d05040d3ec68: deleting
Sep 18 13:29:26 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] group_snapshot 28a0301d-257b-4a59-aad9-d05040d3ec68: deleting {{(pid=82799) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 13:29:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-0927929f-0751-4b63-94df-f6a08227f3bf" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-0927929f-0751-4b63-94df-f6a08227f3bf" acquired by "delete_snapshot" :: waited 0.075s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-07efea02-0341-458d-8a40-d5197e65dc32" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-07efea02-0341-458d-8a40-d5197e65dc32" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Deleting offline snapshot 07efea02-0341-458d-8a40-d5197e65dc32 of volume 0927929f-0751-4b63-94df-f6a08227f3bf {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:29:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] snapshot_file for this snap is: volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:29:26 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8a7772-f159-44a0-a89b-12b9a010fb4b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:27 devstack quobyte-client[82822]: System call of process 87563 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32" returned: 0 in 0.768s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0927929f-0751-4b63-94df-f6a08227f3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:29:27 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fb7afd-af3b-4c44-ad13-5303b69ad4da]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:28 devstack quobyte-client[82822]: System call of process 87567 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf" returned: 0 in 1.139s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32" returned: 0 in 0.430s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf.07efea02-0341-458d-8a40-d5197e65dc32" returned: 0 in 0.126s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-07efea02-0341-458d-8a40-d5197e65dc32" released by "_delete_snapshot" :: held 3.083s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-0927929f-0751-4b63-94df-f6a08227f3bf" released by "delete_snapshot" :: held 3.113s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-695dc121-7204-45bb-b4ab-b52c6ecd5eab" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-695dc121-7204-45bb-b4ab-b52c6ecd5eab" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Deleting offline snapshot 695dc121-7204-45bb-b4ab-b52c6ecd5eab of volume b1e02df8-a95e-4ac0-a6d6-3a09a017f21a {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] snapshot_file for this snap is: volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[792cbae4-caaf-4679-9874-78ee022f4427]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab" returned: 0 in 0.563s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[58253b4c-1bfe-48c8-9b6b-1f45164d77f0]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" returned: 0 in 0.567s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab" returned: 0 in 0.221s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a.695dc121-7204-45bb-b4ab-b52c6ecd5eab" returned: 0 in 0.097s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-695dc121-7204-45bb-b4ab-b52c6ecd5eab" released by "_delete_snapshot" :: held 1.855s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" released by "delete_snapshot" :: held 1.892s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:32 devstack cinder-volume[82799]: WARNING cinder.quota [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-585359874 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-585359874, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:29:32 devstack cinder-volume[82799]: WARNING cinder.quota [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-585359874 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-585359874, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:29:32 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['57c65675-1aad-4efb-9d78-b6267d4960b8', 'bb42faff-78aa-4ee0-83e7-52646c8077cd', '43e01fe3-c7f9-47c0-90ad-71405e81838f', 'f8b3be14-90e1-4812-a3b7-fef0d819d6c8'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:32 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['5e7283d8-7771-4a67-883a-ba0bac7ee52e', 'e6baab29-fae0-4ad1-b21e-b77a74e834d9', '8162de91-ba1b-4e08-b44d-f35594cfea86', 'd5d3cca8-8bdc-4cc8-8a46-1caed3c71131'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:32 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8947d52e-bd41-4d7b-8ff3-83cc263fce74 tempest-GroupSnapshotsTest-832653071 None] group_snapshot 28a0301d-257b-4a59-aad9-d05040d3ec68: deleted successfully
Sep 18 13:29:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-0927929f-0751-4b63-94df-f6a08227f3bf" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-0927929f-0751-4b63-94df-f6a08227f3bf" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8b000-9170-4f9a-80d5-070916f71c4f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf" returned: 0 in 0.478s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0927929f-0751-4b63-94df-f6a08227f3bf" returned: 0 in 0.111s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-0927929f-0751-4b63-94df-f6a08227f3bf" released by "delete_volume" :: held 0.776s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" acquired by "delete_volume" :: waited 0.034s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c51a94a-fb9d-4a87-8f38-2e6c824ad652]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" returned: 0 in 1.154s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" returned: 0 in 0.491s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-b1e02df8-a95e-4ac0-a6d6-3a09a017f21a" released by "delete_volume" :: held 2.120s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:38 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['7049bb60-e746-45f2-a811-d8f2b289f8b0'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:38 devstack cinder-volume[82799]: WARNING cinder.quota [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-585359874 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-585359874, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:29:39 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['110bbb80-c074-4937-9b9c-d85fe8a7a980', '80413c39-b745-40ba-84bb-db751d8c1b67', '95357f3a-1d3e-4065-a5e9-2588f7bef510', 'da1fde5b-e9b4-439b-9358-cd3cf4ec9cb3'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:39 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['81b1d825-8e29-42bb-80eb-2347f859032f', '20c26756-8ce7-4847-9b2c-e7dddc7ff963', '7a586fe3-7cf3-472a-bd8f-ba9c9dbb31e9', '3b9df880-484d-40c4-b261-ccaa9cd5e669'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:29:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:29:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.282s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:40 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:29:40 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-35b2874a-b19a-4d6c-b704-7a5a8fc84498 tempest-GroupSnapshotsTest-832653071 None] Delete group completed successfully.
Sep 18 13:29:41 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-85cb63e4-0f95-46e1-a667-918ff0d1cc35 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:41 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-85cb63e4-0f95-46e1-a667-918ff0d1cc35 tempest-GroupSnapshotsTest-832653071 None] Group tempest-GroupSnapshotsTest-Group-367837165: creating
Sep 18 13:29:41 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-85cb63e4-0f95-46e1-a667-918ff0d1cc35 tempest-GroupSnapshotsTest-832653071 None] Group tempest-GroupSnapshotsTest-Group-367837165: created successfully
Sep 18 13:29:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-85cb63e4-0f95-46e1-a667-918ff0d1cc35 tempest-GroupSnapshotsTest-832653071 None] Create group completed successfully.
Sep 18 13:29:43 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Flow 'volume_create_manager' (7cf36a9e-467e-4ce9-9811-acc5da6af21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26578dc6-91fa-4218-96c0-40e03490ae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26578dc6-91fa-4218-96c0-40e03490ae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-735544309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=27b2bc33-5c4d-4565-8c07-7d5f10114043,host='devstack@QuobyteHD#QuobyteHD',id=180fb50c-e7ae-49cd-95ab-a1b873b7ab2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d642a107b0d44388bfaf662db35f863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:29:43Z,use_quota=True,user_id='4d3be15a40c64caf974ae9f0c9a8ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c854a9-4934-4011-887e-85c55fcdc412),volume_type_id=b4c854a9-4934-4011-887e-85c55fcdc412)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d59dcc-9f1b-4942-8fc0-db02484461d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d59dcc-9f1b-4942-8fc0-db02484461d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60de9c2e-29ec-4a92-9200-8a1792a761ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60de9c2e-29ec-4a92-9200-8a1792a761ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '180fb50c-e7ae-49cd-95ab-a1b873b7ab2a', 'volume_name': 'volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f9dcb8-7f08-433f-a904-d259ce419dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f9dcb8-7f08-433f-a904-d259ce419dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b2cf10-baf5-4af1-9499-6e5b88f8e167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:43 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Volume 180fb50c-e7ae-49cd-95ab-a1b873b7ab2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a', 'volume_size': 1}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=27b2bc33-5c4d-4565-8c07-7d5f10114043,created_at=2025-09-18T11:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-735544309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=27b2bc33-5c4d-4565-8c07-7d5f10114043,host='devstack@QuobyteHD#QuobyteHD',id=180fb50c-e7ae-49cd-95ab-a1b873b7ab2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d642a107b0d44388bfaf662db35f863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:29:43Z,use_quota=True,user_id='4d3be15a40c64caf974ae9f0c9a8ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c854a9-4934-4011-887e-85c55fcdc412),volume_type_id=b4c854a9-4934-4011-887e-85c55fcdc412)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Creating volume 180fb50c-e7ae-49cd-95ab-a1b873b7ab2a {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:29:43 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:29:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:44 devstack quobyte-client[82822]: System call of process 87647 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:44 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=22, name=volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:29:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a 1073741824" returned: 0 in 0.620s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" returned: 0 in 0.252s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:44 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] <== create_volume: return (1085ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:29:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b2cf10-baf5-4af1-9499-6e5b88f8e167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffb3d79-541f-43e0-90e6-71fed544e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:29:45 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Volume volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a (180fb50c-e7ae-49cd-95ab-a1b873b7ab2a): created successfully
Sep 18 13:29:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffb3d79-541f-43e0-90e6-71fed544e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:29:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Flow 'volume_create_manager' (7cf36a9e-467e-4ce9-9811-acc5da6af21e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:29:45 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-d0642518-927b-410d-85d8-445aa63b36f6 tempest-GroupSnapshotsTest-832653071 None] Created volume successfully.
Sep 18 13:29:45 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=92,cinder:UPDATE=106,cinder:DELETE=3,cinder:INSERT=23 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=82,cinder:UPDATE=83,cinder:INSERT=16,cinder:DELETE=4 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-ab102930-2b4a-49de-90c3-ab2420b1d973 req-e9a7a184-9083-47ce-804a-a43ea5e8287b tempest-TaggedAttachmentsTest-1916704525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-ab102930-2b4a-49de-90c3-ab2420b1d973 req-e9a7a184-9083-47ce-804a-a43ea5e8287b tempest-TaggedAttachmentsTest-1916704525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a268ae9-4792-494d-a2e2-cd4342bb7178]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-ab102930-2b4a-49de-90c3-ab2420b1d973 req-e9a7a184-9083-47ce-804a-a43ea5e8287b tempest-TaggedAttachmentsTest-1916704525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:46 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] GroupSnapshot 9acfbb59-3f23-42a8-b450-8af18363587e: creating.
Sep 18 13:29:46 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Group snapshot 9acfbb59-3f23-42a8-b450-8af18363587e: creating. {{(pid=82799) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-ab102930-2b4a-49de-90c3-ab2420b1d973 req-e9a7a184-9083-47ce-804a-a43ea5e8287b tempest-TaggedAttachmentsTest-1916704525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962" returned: 0 in 0.878s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-ab102930-2b4a-49de-90c3-ab2420b1d973 req-e9a7a184-9083-47ce-804a-a43ea5e8287b tempest-TaggedAttachmentsTest-1916704525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.925s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.301s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Creating offline snapshot d9bfa40b-21db-4892-805d-8bdfb8b384b0 of volume 180fb50c-e7ae-49cd-95ab-a1b873b7ab2a {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:29:47 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[63320c7b-f6f1-4e07-a250-8be511e0ff41]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-ab102930-2b4a-49de-90c3-ab2420b1d973 req-e9a7a184-9083-47ce-804a-a43ea5e8287b tempest-TaggedAttachmentsTest-1916704525 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-fa7e8817-39ed-4b60-9315-1f351c38d962', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c05e0dae-a914-41ce-afea-ae3ff8c80c37', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:29:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-ab102930-2b4a-49de-90c3-ab2420b1d973 req-e9a7a184-9083-47ce-804a-a43ea5e8287b tempest-TaggedAttachmentsTest-1916704525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" returned: 0 in 0.693s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:48 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=23, name=volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:29:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-ab102930-2b4a-49de-90c3-ab2420b1d973 req-e9a7a184-9083-47ce-804a-a43ea5e8287b tempest-TaggedAttachmentsTest-1916704525 None] attachment_update completed successfully.
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 1G" returned: 0 in 0.501s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img rebase -u -b volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img rebase -u -b volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0" returned: 0 in 0.199s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0" returned: 0 in 0.198s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0" returned: 0 in 0.133s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.info" returned: 0 in 0.197s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:29:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.info" returned: 0 in 0.117s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:49 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c8d5cbc5-af4d-481b-b033-9058b9e5e8ae tempest-GroupSnapshotsTest-832653071 None] group_snapshot 9acfbb59-3f23-42a8-b450-8af18363587e: created successfully
Sep 18 13:29:51 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] group_snapshot 9acfbb59-3f23-42a8-b450-8af18363587e: deleting
Sep 18 13:29:51 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] group_snapshot 9acfbb59-3f23-42a8-b450-8af18363587e: deleting {{(pid=82799) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-d9bfa40b-21db-4892-805d-8bdfb8b384b0" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-d9bfa40b-21db-4892-805d-8bdfb8b384b0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Deleting offline snapshot d9bfa40b-21db-4892-805d-8bdfb8b384b0 of volume 180fb50c-e7ae-49cd-95ab-a1b873b7ab2a {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] snapshot_file for this snap is: volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd2882b-8fda-43ea-94e3-4aa62f2cb4a9]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0" returned: 0 in 0.453s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:29:52 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[855ba696-cbfe-453e-8e9c-f731b8f5287f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" returned: 0 in 0.509s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:52 devstack quobyte-client[82822]: System call of process 88070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:29:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0" returned: 0 in 0.264s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a.d9bfa40b-21db-4892-805d-8bdfb8b384b0" returned: 0 in 0.107s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-d9bfa40b-21db-4892-805d-8bdfb8b384b0" released by "_delete_snapshot" :: held 1.680s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" released by "delete_snapshot" :: held 1.706s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:53 devstack cinder-volume[82799]: WARNING cinder.quota [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-229545427 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-229545427, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:29:53 devstack cinder-volume[82799]: WARNING cinder.quota [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-229545427 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-229545427, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:29:54 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] Created reservations ['a60a4bc9-e745-4ffb-b46e-5f1c23cf16cd', 'a1f0bc10-bfe2-474a-9074-e7b82ecbbda4', 'aa347b7f-9558-4937-9909-8ab63bd4021c', '845bbf18-1684-419d-b71f-57d2c6553e02'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-16de6410-bf55-487d-b242-af9d5d8d04be tempest-GroupSnapshotsTest-832653071 None] group_snapshot 9acfbb59-3f23-42a8-b450-8af18363587e: deleted successfully
Sep 18 13:29:55 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:29:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "cinder-quobyte-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:29:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" acquired by "delete_volume" :: waited 0.025s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:29:55 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13fb64a-333b-4e2b-80eb-77edeee6b6b5]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:29:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" returned: 0 in 0.500s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" returned: 0 in 0.157s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:56 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Lock "cinder-quobyte-180fb50c-e7ae-49cd-95ab-a1b873b7ab2a" released by "delete_volume" :: held 0.863s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:29:56 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['312567a4-250c-49aa-8ff9-594f51ee1f05'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:56 devstack cinder-volume[82799]: WARNING cinder.quota [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-229545427 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-229545427, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:29:56 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Created reservations ['fcedb3e9-14b1-4d7a-84b7-830d61b22a7a', 'd5a548db-3883-45d5-8179-30771f049a7c', 'd378f1df-6acf-4dec-8ba7-668fb808d5ca', '517e3641-b371-4d87-a300-7f7582bfee20'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:29:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:29:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:29:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:29:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:29:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:29:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:29:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.098s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:29:57 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:29:57 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c10e3994-e7fc-4520-97ae-40fb58251172 tempest-GroupSnapshotsTest-832653071 None] Delete group completed successfully.
Sep 18 13:30:06 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-6906c7cb-ef0c-4a08-9eb7-27a1eb1bdbd0 tempest-GroupSnapshotsV319Test-1914109852 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:30:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-6906c7cb-ef0c-4a08-9eb7-27a1eb1bdbd0 tempest-GroupSnapshotsV319Test-1914109852 None] Group tempest-GroupSnapshotsV319Test-Group-371032268: creating
Sep 18 13:30:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-6906c7cb-ef0c-4a08-9eb7-27a1eb1bdbd0 tempest-GroupSnapshotsV319Test-1914109852 None] Group tempest-GroupSnapshotsV319Test-Group-371032268: created successfully
Sep 18 13:30:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-6906c7cb-ef0c-4a08-9eb7-27a1eb1bdbd0 tempest-GroupSnapshotsV319Test-1914109852 None] Create group completed successfully.
Sep 18 13:30:07 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Flow 'volume_create_manager' (e24aa697-a3db-48e0-8377-f06022cc429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16672e40-92a0-42b0-a766-238d410a5ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16672e40-92a0-42b0-a766-238d410a5ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-908912522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6cb80c9b-a6c3-4f5e-a619-a51495d0c3eb,host='devstack@QuobyteHD#QuobyteHD',id=394f01eb-a589-497a-a9e2-1c5ee661a7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735bd6baa0f14a53ae6e6fb18e2d04e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:30:07Z,use_quota=True,user_id='971ac96a8ae34b82bb8c0887633816ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fe8fd23-f2bb-46e4-8b50-eb10ad336544),volume_type_id=4fe8fd23-f2bb-46e4-8b50-eb10ad336544)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbddd948-6fdb-411a-845c-ee23701cd992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbddd948-6fdb-411a-845c-ee23701cd992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cb183d-6412-4d86-89e2-75527361fa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cb183d-6412-4d86-89e2-75527361fa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394f01eb-a589-497a-a9e2-1c5ee661a7e6', 'volume_name': 'volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df17baba-923e-489c-be29-68ff6e95d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df17baba-923e-489c-be29-68ff6e95d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65010fe-d8dd-4feb-8821-141cae9c1b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:30:07 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Volume 394f01eb-a589-497a-a9e2-1c5ee661a7e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6', 'volume_size': 1}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6cb80c9b-a6c3-4f5e-a619-a51495d0c3eb,created_at=2025-09-18T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-908912522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6cb80c9b-a6c3-4f5e-a619-a51495d0c3eb,host='devstack@QuobyteHD#QuobyteHD',id=394f01eb-a589-497a-a9e2-1c5ee661a7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735bd6baa0f14a53ae6e6fb18e2d04e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:30:07Z,use_quota=True,user_id='971ac96a8ae34b82bb8c0887633816ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fe8fd23-f2bb-46e4-8b50-eb10ad336544),volume_type_id=4fe8fd23-f2bb-46e4-8b50-eb10ad336544)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Creating volume 394f01eb-a589-497a-a9e2-1c5ee661a7e6 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:30:07 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:30:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:07 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=25, name=volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:30:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 1073741824" returned: 0 in 0.328s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6" returned: 0 in 0.100s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] <== create_volume: return (503ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:30:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.517s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:30:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65010fe-d8dd-4feb-8821-141cae9c1b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:30:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08acc23b-bbda-4d4b-8d63-ee8f8dc1f83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:30:08 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Volume volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 (394f01eb-a589-497a-a9e2-1c5ee661a7e6): created successfully
Sep 18 13:30:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08acc23b-bbda-4d4b-8d63-ee8f8dc1f83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:30:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Flow 'volume_create_manager' (e24aa697-a3db-48e0-8377-f06022cc429f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:30:08 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-df9fb3e7-57f0-4473-8950-533627c78cb6 tempest-GroupSnapshotsV319Test-1914109852 None] Created volume successfully.
Sep 18 13:30:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] GroupSnapshot 7982738e-659c-4462-b716-19d8463211bb: creating.
Sep 18 13:30:10 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:30:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Group snapshot 7982738e-659c-4462-b716-19d8463211bb: creating. {{(pid=82799) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 13:30:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:30:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:30:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Creating offline snapshot 5d4450bc-e548-4907-8206-f13b9f39359d of volume 394f01eb-a589-497a-a9e2-1c5ee661a7e6 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:30:10 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e25d58-a7f1-4360-88a0-1fc3752cd706]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:30:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6" returned: 0 in 1.179s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:12 devstack quobyte-client[82822]: System call of process 88217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:30:12 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=26, name=volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:30:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:30:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:30:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.129s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:30:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.175s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d 1G" returned: 0 in 1.444s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): qemu-img rebase -u -b volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.386s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:30:13 devstack quobyte-client[82822]: System call of process 88248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] CMD "qemu-img rebase -u -b volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d" returned: 0 in 0.455s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d" returned: 0 in 0.163s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:30:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d" returned: 0 in 0.160s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.info" returned: 0 in 0.161s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:30:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.info" returned: 0 in 0.132s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.157s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:30:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-fd1cc34c-2099-4c2e-9ff2-98084b67c70f tempest-GroupSnapshotsV319Test-1914109852 None] group_snapshot 7982738e-659c-4462-b716-19d8463211bb: created successfully
Sep 18 13:30:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] group_snapshot 7982738e-659c-4462-b716-19d8463211bb: deleting
Sep 18 13:30:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:30:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] group_snapshot 7982738e-659c-4462-b716-19d8463211bb: deleting {{(pid=82799) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 13:30:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Acquiring lock "cinder-quobyte-394f01eb-a589-497a-a9e2-1c5ee661a7e6" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:30:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "cinder-quobyte-394f01eb-a589-497a-a9e2-1c5ee661a7e6" acquired by "delete_snapshot" :: waited 0.063s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:30:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Acquiring lock "cinder-quobyte-5d4450bc-e548-4907-8206-f13b9f39359d" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:30:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "cinder-quobyte-5d4450bc-e548-4907-8206-f13b9f39359d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:30:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Deleting offline snapshot 5d4450bc-e548-4907-8206-f13b9f39359d of volume 394f01eb-a589-497a-a9e2-1c5ee661a7e6 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:30:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] snapshot_file for this snap is: volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:30:16 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc157b-d0b4-4fa5-bfca-beacd1292166]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:30:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d" returned: 0 in 0.478s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:30:17 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1805f02d-6980-470e-acd6-93f578f2aceb]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:30:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:18 devstack quobyte-client[82822]: System call of process 88276 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:30:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6" returned: 0 in 0.666s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d" returned: 0 in 0.313s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6.5d4450bc-e548-4907-8206-f13b9f39359d" returned: 0 in 0.093s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "cinder-quobyte-5d4450bc-e548-4907-8206-f13b9f39359d" released by "_delete_snapshot" :: held 1.868s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:30:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "cinder-quobyte-394f01eb-a589-497a-a9e2-1c5ee661a7e6" released by "delete_snapshot" :: held 1.898s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:30:19 devstack cinder-volume[82799]: WARNING cinder.quota [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-914415984 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-914415984, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:30:19 devstack cinder-volume[82799]: WARNING cinder.quota [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-914415984 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-914415984, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:30:19 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] Created reservations ['d384592f-c2f4-455a-8b95-52195d3d1678', 'fdf155e3-575a-4337-80cf-b475a6562c91', 'e65d594d-e77c-4345-896f-f88f4fe8f12e', '8a709ec0-a170-4fff-b65c-24cb5e60d7f1'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:30:20 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9e122727-aa13-41a3-8f01-bad9e241c878 tempest-GroupSnapshotsV319Test-1914109852 None] group_snapshot 7982738e-659c-4462-b716-19d8463211bb: deleted successfully
Sep 18 13:30:20 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-75d78c6e-8e39-415f-85b7-414ef07781bb req-6a5dd5a3-de24-463b-a994-49f986f8ec98 tempest-TaggedAttachmentsTest-1916704525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:30:20 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-75d78c6e-8e39-415f-85b7-414ef07781bb req-6a5dd5a3-de24-463b-a994-49f986f8ec98 tempest-TaggedAttachmentsTest-1916704525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:30:20 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-75d78c6e-8e39-415f-85b7-414ef07781bb req-6a5dd5a3-de24-463b-a994-49f986f8ec98 tempest-TaggedAttachmentsTest-1916704525 None] Terminate volume connection completed successfully.
Sep 18 13:30:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-75d78c6e-8e39-415f-85b7-414ef07781bb req-6a5dd5a3-de24-463b-a994-49f986f8ec98 tempest-TaggedAttachmentsTest-1916704525 None] Deleting attachment c05e0dae-a914-41ce-afea-ae3ff8c80c37. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:30:20 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:30:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Acquiring lock "cinder-quobyte-394f01eb-a589-497a-a9e2-1c5ee661a7e6" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:30:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "cinder-quobyte-394f01eb-a589-497a-a9e2-1c5ee661a7e6" acquired by "delete_volume" :: waited 0.031s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:30:21 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd37ef41-49c4-4511-bcc6-a76834b2a8c8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:30:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:21 devstack quobyte-client[82822]: System call of process 88293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:30:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6" returned: 0 in 1.024s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-394f01eb-a589-497a-a9e2-1c5ee661a7e6" returned: 0 in 0.556s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "cinder-quobyte-394f01eb-a589-497a-a9e2-1c5ee661a7e6" released by "delete_volume" :: held 2.155s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:30:23 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Created reservations ['797f325f-8b4d-4e55-b009-b9665d030026'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:30:24 devstack cinder-volume[82799]: WARNING cinder.quota [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-914415984 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-914415984, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:30:24 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Created reservations ['285d2f3b-9d86-4765-ae67-b3933c3d4be7', 'd40e97bc-34a9-4a14-bf8d-6d0a94f12702', 'f51ca972-ff0a-46be-aa58-1a7ed409e645', '39bea264-4410-46f7-acc9-dad8b5ceabb6'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:30:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:30:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:30:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:30:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:30:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:30:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.146s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:24 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:30:25 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c89d9d43-f8f1-4b9f-aacd-843e736f2a60 tempest-GroupSnapshotsV319Test-1914109852 None] Delete group completed successfully.
Sep 18 13:30:34 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=51,cinder:UPDATE=36,cinder:INSERT=10 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:30:34 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=49,cinder:UPDATE=47,cinder:INSERT=8,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:30:42 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-33c689fd-6f68-41b0-b7fd-7634ec337cd5 tempest-GroupsV320Test-360426310 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:30:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-33c689fd-6f68-41b0-b7fd-7634ec337cd5 tempest-GroupsV320Test-360426310 None] Group tempest-GroupsV320Test-Group-603290531: creating
Sep 18 13:30:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-33c689fd-6f68-41b0-b7fd-7634ec337cd5 tempest-GroupsV320Test-360426310 None] Group tempest-GroupsV320Test-Group-603290531: created successfully
Sep 18 13:30:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-33c689fd-6f68-41b0-b7fd-7634ec337cd5 tempest-GroupsV320Test-360426310 None] Create group completed successfully.
Sep 18 13:30:43 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:30:43 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Created reservations ['c0c13edc-3016-4d1c-b5e0-247b17ca5e33'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:30:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:30:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:30:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:30:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:30:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:30:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:30:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.128s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:30:44 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:30:44 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4a8b23e6-3813-4de1-84a5-c3c8c1439616 tempest-GroupsV320Test-360426310 None] Delete group completed successfully.
Sep 18 13:30:53 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:30:54 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:31:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Acquiring lock "cinder-fa7e8817-39ed-4b60-9315-1f351c38d962-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Lock "cinder-fa7e8817-39ed-4b60-9315-1f351c38d962-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:07 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Acquiring lock "cinder-quobyte-fa7e8817-39ed-4b60-9315-1f351c38d962" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Lock "cinder-quobyte-fa7e8817-39ed-4b60-9315-1f351c38d962" acquired by "delete_volume" :: waited 0.019s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:07 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70ea2e3-9916-4262-bec5-2b24570358e0]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:31:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:08 devstack quobyte-client[82822]: System call of process 88432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:31:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962" returned: 0 in 0.610s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fa7e8817-39ed-4b60-9315-1f351c38d962" returned: 0 in 0.150s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Lock "cinder-quobyte-fa7e8817-39ed-4b60-9315-1f351c38d962" released by "delete_volume" :: held 1.057s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Flow 'volume_create_manager' (17c9e676-6f12-4d0a-acb6-c8eb9cced0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af397ff-7c4f-490d-9656-46a028070387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af397ff-7c4f-490d-9656-46a028070387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1838871360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ba1c1-4b14-4c71-8aa2-619e53c969ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8f56bab3f845ebac96007d00c9c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:31:09Z,use_quota=True,user_id='d92d906d283a49dcb2609f8a45f7a091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0a5ae-cf9f-427a-98a7-0132ee183a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0a5ae-cf9f-427a-98a7-0132ee183a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f393047-dfd9-4fa7-8b16-9e2bb632246b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f393047-dfd9-4fa7-8b16-9e2bb632246b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407ba1c1-4b14-4c71-8aa2-619e53c969ab', 'volume_name': 'volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea60e8d-9e16-40e9-bbd7-8f37abe484b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea60e8d-9e16-40e9-bbd7-8f37abe484b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd368db-c386-4693-9608-4f988651bf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:09 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Volume 407ba1c1-4b14-4c71-8aa2-619e53c969ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab', 'volume_size': 1}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1838871360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ba1c1-4b14-4c71-8aa2-619e53c969ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8f56bab3f845ebac96007d00c9c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:31:09Z,use_quota=True,user_id='d92d906d283a49dcb2609f8a45f7a091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Creating volume 407ba1c1-4b14-4c71-8aa2-619e53c969ab {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:31:09 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:09 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=28, name=volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:31:09 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Created reservations ['474724ad-95d8-40db-8209-3a6f35eafa95', '9d73a378-c528-4502-a300-bcf464158618', '9c8f7bff-0e4f-44ae-a5d9-bdb9adc84ca0', '759f313b-14ec-41b9-b239-33bce6b84f1f'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab 1073741824" returned: 0 in 0.558s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab" returned: 0 in 0.321s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] <== create_volume: return (924ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd368db-c386-4693-9608-4f988651bf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7cc2af-2040-4161-88ca-3a6db06d7b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:10 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Volume volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab (407ba1c1-4b14-4c71-8aa2-619e53c969ab): created successfully
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7cc2af-2040-4161-88ca-3a6db06d7b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Flow 'volume_create_manager' (17c9e676-6f12-4d0a-acb6-c8eb9cced0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:31:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.448s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:11 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:31:11 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-dd4f2a6e-2c47-4a48-93d2-9d8612cd87ba tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Created volume successfully.
Sep 18 13:31:11 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Deleted volume successfully.
Sep 18 13:31:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-4b9e476d-0e96-4bd6-8f10-fb6c9837c70a tempest-TaggedAttachmentsTest-1916704525 None] Lock "cinder-fa7e8817-39ed-4b60-9315-1f351c38d962-delete_volume" released by "delete_volume" :: held 3.766s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:31:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:31:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:31:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.174s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:31:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Acquiring lock "cinder-407ba1c1-4b14-4c71-8aa2-619e53c969ab-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "cinder-407ba1c1-4b14-4c71-8aa2-619e53c969ab-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:14 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Acquiring lock "cinder-quobyte-407ba1c1-4b14-4c71-8aa2-619e53c969ab" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "cinder-quobyte-407ba1c1-4b14-4c71-8aa2-619e53c969ab" acquired by "delete_volume" :: waited 0.020s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:14 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e174dfee-d5af-46dc-800a-ae971edfd15b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:31:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab" returned: 0 in 0.806s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-407ba1c1-4b14-4c71-8aa2-619e53c969ab" returned: 0 in 0.127s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "cinder-quobyte-407ba1c1-4b14-4c71-8aa2-619e53c969ab" released by "delete_volume" :: held 1.200s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:15 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Created reservations ['4fcb794e-15f7-4e98-9236-4f4a08126b0f', '0c1091ba-5370-4bf6-aa15-12a18ba0607d', 'b0b28a62-03ca-42fb-ba9b-101570a803c0', 'c68214c2-5aab-46ce-ae6a-5c892cacd873'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:31:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:31:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:31:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.169s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:16 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:31:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Deleted volume successfully.
Sep 18 13:31:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f0c86ebb-3c54-411a-9782-d8136b58441b tempest-VolumeQuotasNegativeTestJSON-1701380914 None] Lock "cinder-407ba1c1-4b14-4c71-8aa2-619e53c969ab-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=11,cinder:UPDATE=13,cinder:INSERT=1,cinder:DELETE=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=12,cinder:INSERT=7,cinder:UPDATE=24 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:31:27 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Flow 'volume_create_manager' (b386f20c-6407-40dc-b2c3-86d73c2e6580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4200a1-cbc6-4514-8803-b3d0577e7461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4200a1-cbc6-4514-8803-b3d0577e7461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1510565841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d870ea20-8037-47e2-a8c9-69748ba6fe9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173ffbf1d6b447bba81397b161b2ce52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:31:27Z,use_quota=True,user_id='8271e273518347e4b46abe2584c87d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8ff620-afc1-45fe-8624-fba2ce9ecb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8ff620-afc1-45fe-8624-fba2ce9ecb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea765bf8-df59-465f-b459-02340b8f3906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea765bf8-df59-465f-b459-02340b8f3906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd870ea20-8037-47e2-a8c9-69748ba6fe9b', 'volume_name': 'volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d806d2-655c-4572-9e3b-3f7e717c6b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d806d2-655c-4572-9e3b-3f7e717c6b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b690c09-f38a-4668-a0c7-7eb9cfd019dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:27 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Volume d870ea20-8037-47e2-a8c9-69748ba6fe9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b', 'volume_size': 1}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1510565841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d870ea20-8037-47e2-a8c9-69748ba6fe9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173ffbf1d6b447bba81397b161b2ce52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:31:27Z,use_quota=True,user_id='8271e273518347e4b46abe2584c87d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Creating volume d870ea20-8037-47e2-a8c9-69748ba6fe9b {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:31:27 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:31:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:28 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=29, name=volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:31:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b 1073741824" returned: 0 in 0.686s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b" returned: 0 in 0.130s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] <== create_volume: return (947ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:31:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b690c09-f38a-4668-a0c7-7eb9cfd019dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2786f9d4-7b34-4d1a-b84b-d8c060177815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:29 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Volume volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b (d870ea20-8037-47e2-a8c9-69748ba6fe9b): created successfully
Sep 18 13:31:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2786f9d4-7b34-4d1a-b84b-d8c060177815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Flow 'volume_create_manager' (b386f20c-6407-40dc-b2c3-86d73c2e6580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:31:29 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-806946d1-c834-431e-ae77-20550fc77dc3 tempest-VolumesServicesTestJSON-159788763 None] Created volume successfully.
Sep 18 13:31:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Acquiring lock "cinder-d870ea20-8037-47e2-a8c9-69748ba6fe9b-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Lock "cinder-d870ea20-8037-47e2-a8c9-69748ba6fe9b-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:30 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Acquiring lock "cinder-quobyte-d870ea20-8037-47e2-a8c9-69748ba6fe9b" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Lock "cinder-quobyte-d870ea20-8037-47e2-a8c9-69748ba6fe9b" acquired by "delete_volume" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:30 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3050eb68-436b-4382-8b1c-1d79addf278f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:31:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b" returned: 0 in 0.461s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d870ea20-8037-47e2-a8c9-69748ba6fe9b" returned: 0 in 0.103s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Lock "cinder-quobyte-d870ea20-8037-47e2-a8c9-69748ba6fe9b" released by "delete_volume" :: held 0.737s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Created reservations ['89c15c7d-c48f-482f-8509-09819960374f', '36db8712-faa4-4756-b6f3-fc3476e7492e', '56c61419-db9d-4183-88f1-50e243ce0191', '112e1604-9596-49ac-be16-0b0dd3003e1a'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.090s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:31:31 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Deleted volume successfully.
Sep 18 13:31:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-06927d6e-3bf5-4f9d-8620-15198c2d318e tempest-VolumesServicesTestJSON-159788763 None] Lock "cinder-d870ea20-8037-47e2-a8c9-69748ba6fe9b-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:33 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:33 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:31:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Flow 'volume_create_manager' (318670d8-4ec5-4811-936e-efee69b02a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1911091-0822-45c7-956d-582fbecbd836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1911091-0822-45c7-956d-582fbecbd836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2066501727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc136a134457439f9a11aad3687874f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:31:33Z,use_quota=True,user_id='646839e62e6042bea92e1762f9f54028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb26c3a-8da9-4e8e-8307-4b6386eb9b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb26c3a-8da9-4e8e-8307-4b6386eb9b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d2267d-3e8b-4fb6-9cb8-607e68c45d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d2267d-3e8b-4fb6-9cb8-607e68c45d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af', 'volume_name': 'volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5c49c3-99c9-4002-b1d2-aa32ab07863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5c49c3-99c9-4002-b1d2-aa32ab07863d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4b00e4-4fc8-42eb-95ff-ab81bef1a254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:34 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Volume cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af', 'volume_size': 1}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2066501727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc136a134457439f9a11aad3687874f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:31:33Z,use_quota=True,user_id='646839e62e6042bea92e1762f9f54028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Creating volume cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:31:34 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:34 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=30, name=volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:31:34 devstack quobyte-client[82822]: System call of process 88524 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af 1073741824" returned: 0 in 0.458s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af" returned: 0 in 0.171s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] <== create_volume: return (722ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:31:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4b00e4-4fc8-42eb-95ff-ab81bef1a254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9b8857-e41e-4b92-b7f4-faf82fe51351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:35 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Volume volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af (cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af): created successfully
Sep 18 13:31:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9b8857-e41e-4b92-b7f4-faf82fe51351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Flow 'volume_create_manager' (318670d8-4ec5-4811-936e-efee69b02a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:31:35 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-5226cbde-954f-41f2-9706-cfc9e06e0855 tempest-AttachVolumeNegativeTest-182207659 None] Created volume successfully.
Sep 18 13:31:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-3af22ccc-0250-48cf-8647-dfaa1909c5d3 req-946ddd8f-e7b5-416a-9928-544b13a3196f tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-3af22ccc-0250-48cf-8647-dfaa1909c5d3 req-946ddd8f-e7b5-416a-9928-544b13a3196f tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:40 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f40576-fdd1-478a-a1e7-f762949f86e1]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:31:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-3af22ccc-0250-48cf-8647-dfaa1909c5d3 req-946ddd8f-e7b5-416a-9928-544b13a3196f tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:40 devstack quobyte-client[82822]: System call of process 88537 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:31:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-3af22ccc-0250-48cf-8647-dfaa1909c5d3 req-946ddd8f-e7b5-416a-9928-544b13a3196f tempest-AttachVolumeNegativeTest-182207659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af" returned: 0 in 0.578s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-3af22ccc-0250-48cf-8647-dfaa1909c5d3 req-946ddd8f-e7b5-416a-9928-544b13a3196f tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.678s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:41 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Flow 'volume_create_manager' (3cc71d9d-73e1-4d35-bc54-081bc73dd219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685523f8-112b-4c7d-bd9b-d064c52e4157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-3af22ccc-0250-48cf-8647-dfaa1909c5d3 req-946ddd8f-e7b5-416a-9928-544b13a3196f tempest-AttachVolumeNegativeTest-182207659 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '405f44be-28f5-46db-9b73-2482ab68db10', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:31:41 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-3af22ccc-0250-48cf-8647-dfaa1909c5d3 req-946ddd8f-e7b5-416a-9928-544b13a3196f tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685523f8-112b-4c7d-bd9b-d064c52e4157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1275293894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f525d21-edfc-4bb6-bc30-d48bfcf0aff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fd4f5cd18a4911ac8b94e23a5d2210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:31:41Z,use_quota=True,user_id='d2c2cfbecdca491fad894ece0f6379de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc7107a-b747-4fb2-8549-59bee6a93d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc7107a-b747-4fb2-8549-59bee6a93d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cd1867-d196-4cc2-88eb-ea802a9ac8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cd1867-d196-4cc2-88eb-ea802a9ac8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f525d21-edfc-4bb6-bc30-d48bfcf0aff9', 'volume_name': 'volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c52382-c752-4c71-aeff-dbf1b2780421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c52382-c752-4c71-aeff-dbf1b2780421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4a4ad8-87de-4b62-bf0f-4d01bad0d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:41 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Volume 1f525d21-edfc-4bb6-bc30-d48bfcf0aff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9', 'volume_size': 1}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1275293894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f525d21-edfc-4bb6-bc30-d48bfcf0aff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fd4f5cd18a4911ac8b94e23a5d2210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:31:41Z,use_quota=True,user_id='d2c2cfbecdca491fad894ece0f6379de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Creating volume 1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:31:41 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:31:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:41 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=31, name=volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:31:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 1073741824" returned: 0 in 0.556s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" returned: 0 in 0.190s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] <== create_volume: return (826ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:31:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:42 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4a4ad8-87de-4b62-bf0f-4d01bad0d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:42 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d0b3ef-1a5f-49fc-a794-7852740bd667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:31:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-3af22ccc-0250-48cf-8647-dfaa1909c5d3 req-946ddd8f-e7b5-416a-9928-544b13a3196f tempest-AttachVolumeNegativeTest-182207659 None] attachment_update completed successfully.
Sep 18 13:31:42 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Volume volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 (1f525d21-edfc-4bb6-bc30-d48bfcf0aff9): created successfully
Sep 18 13:31:42 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d0b3ef-1a5f-49fc-a794-7852740bd667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:31:42 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Flow 'volume_create_manager' (3cc71d9d-73e1-4d35-bc54-081bc73dd219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:31:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-fdb3926b-dbd4-4ee6-a330-77fe33b7077e tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Created volume successfully.
Sep 18 13:31:44 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:44 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Creating offline snapshot 6761662c-bfe1-4dcb-971b-19b526b0d6b3 of volume 1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:31:44 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e0ea06-5d2c-4d04-aa86-2e923d00156c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:31:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:44 devstack quobyte-client[82822]: System call of process 88611 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:31:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" returned: 0 in 0.594s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:45 devstack quobyte-client[82822]: System call of process 88907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:31:45 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=32, name=volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:31:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 1G" returned: 0 in 0.623s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:45 devstack quobyte-client[82822]: System call of process 88935 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:31:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "qemu-img rebase -u -b volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3" returned: 0 in 0.331s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3" returned: 0 in 0.108s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3" returned: 0 in 0.181s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.info" returned: 0 in 0.109s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.info" returned: 0 in 0.157s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:47 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-a1610c61-4046-41e7-bdec-fc880092e41a tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Create snapshot completed successfully
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Acquiring lock "cinder-6761662c-bfe1-4dcb-971b-19b526b0d6b3-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-6761662c-bfe1-4dcb-971b-19b526b0d6b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:48 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Acquiring lock "cinder-quobyte-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-quobyte-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Acquiring lock "cinder-quobyte-6761662c-bfe1-4dcb-971b-19b526b0d6b3" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-quobyte-6761662c-bfe1-4dcb-971b-19b526b0d6b3" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Deleting offline snapshot 6761662c-bfe1-4dcb-971b-19b526b0d6b3 of volume 1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] snapshot_file for this snap is: volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7d50ab-9346-45dd-b8cd-3d6a0cfc87ac]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:31:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3" returned: 0 in 0.726s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:31:49 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cf064a-14a4-4656-9ab2-ca31e6209ebd]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:31:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" returned: 0 in 0.490s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:50 devstack quobyte-client[82822]: System call of process 88951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:31:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3" returned: 0 in 0.393s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9.6761662c-bfe1-4dcb-971b-19b526b0d6b3" returned: 0 in 0.153s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-quobyte-6761662c-bfe1-4dcb-971b-19b526b0d6b3" released by "_delete_snapshot" :: held 2.141s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-quobyte-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" released by "delete_snapshot" :: held 2.234s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:50 devstack cinder-volume[82799]: WARNING cinder.quota [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:31:50 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Created reservations ['a828a4cd-dd70-46f5-b947-8e8b9227741f', '2e172861-7e39-4711-9a24-bfb99454dcbb', '266d26ef-e10d-4a43-b3c5-eb2621b1f00c', '1be36833-fe78-4df3-a583-6c5f1903afd4'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:31:51 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Delete snapshot completed successfully.
Sep 18 13:31:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-04ceea15-6304-4e39-be39-1dfd96249ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-6761662c-bfe1-4dcb-971b-19b526b0d6b3-delete_snapshot" released by "delete_snapshot" :: held 2.861s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Acquiring lock "cinder-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:51 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:31:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Acquiring lock "cinder-quobyte-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:31:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-quobyte-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" acquired by "delete_volume" :: waited 0.022s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:31:51 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fd7f55-ade7-4e00-9d1d-4fc84a6172cf]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:31:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:52 devstack quobyte-client[82822]: System call of process 88955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:31:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" returned: 0 in 0.782s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" returned: 0 in 0.227s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-quobyte-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9" released by "delete_volume" :: held 1.276s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Created reservations ['a82fbe39-4434-443b-8fed-eed28e0bd13c', '4d4f699b-3704-4d35-9b58-e723fd0a57f8', '195de8e9-55a4-429b-97de-7adbcb0e4d8e', '55da7888-d00c-4096-be52-3a7b4ea5c55b'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.125s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:31:53 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:31:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Deleted volume successfully.
Sep 18 13:31:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c111b8d3-4a99-478e-a6f6-d16b69c304e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681287691 None] Lock "cinder-1f525d21-edfc-4bb6-bc30-d48bfcf0aff9-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:32:03 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:INSERT=6 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:32:04 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Flow 'volume_create_manager' (8435a694-e354-47b0-ae4a-118940d8e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244091f3-c568-43e8-b8d7-f70e9b707f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244091f3-c568-43e8-b8d7-f70e9b707f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-74527459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef74e53a-5fbf-40f9-923b-22887838c7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd9fd940b644f049a5de84deb8768d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:32:04Z,use_quota=True,user_id='1fbce1627eac400ea167473b6368dcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4806137-2b70-4cd8-93cf-37219c6d3a85),volume_type_id=a4806137-2b70-4cd8-93cf-37219c6d3a85)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88789fb-ce97-4347-937d-a1e71254522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88789fb-ce97-4347-937d-a1e71254522f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d604f369-a049-4dfb-9538-bc7e8f2c00df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d604f369-a049-4dfb-9538-bc7e8f2c00df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef74e53a-5fbf-40f9-923b-22887838c7e2', 'volume_name': 'volume-ef74e53a-5fbf-40f9-923b-22887838c7e2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551e552e-bca7-4564-8a09-8430c32fc7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551e552e-bca7-4564-8a09-8430c32fc7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7c7de5-d4af-45fe-ac71-f8105cbfef3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:32:04 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Volume ef74e53a-5fbf-40f9-923b-22887838c7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef74e53a-5fbf-40f9-923b-22887838c7e2', 'volume_size': 1}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-74527459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef74e53a-5fbf-40f9-923b-22887838c7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd9fd940b644f049a5de84deb8768d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:32:04Z,use_quota=True,user_id='1fbce1627eac400ea167473b6368dcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4806137-2b70-4cd8-93cf-37219c6d3a85),volume_type_id=a4806137-2b70-4cd8-93cf-37219c6d3a85)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Creating volume ef74e53a-5fbf-40f9-923b-22887838c7e2 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:32:04 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:32:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ef74e53a-5fbf-40f9-923b-22887838c7e2 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:32:04 devstack quobyte-client[82822]: System call of process 88994 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:32:04 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=34, name=volume-ef74e53a-5fbf-40f9-923b-22887838c7e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:32:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ef74e53a-5fbf-40f9-923b-22887838c7e2 1073741824" returned: 0 in 0.577s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:32:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ef74e53a-5fbf-40f9-923b-22887838c7e2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:32:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ef74e53a-5fbf-40f9-923b-22887838c7e2" returned: 0 in 0.208s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:32:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] <== create_volume: return (916ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:32:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:32:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7c7de5-d4af-45fe-ac71-f8105cbfef3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef74e53a-5fbf-40f9-923b-22887838c7e2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:32:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3f22fa-149b-4f5e-9d35-e4d33735cb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:32:05 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Volume volume-ef74e53a-5fbf-40f9-923b-22887838c7e2 (ef74e53a-5fbf-40f9-923b-22887838c7e2): created successfully
Sep 18 13:32:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3f22fa-149b-4f5e-9d35-e4d33735cb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:32:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Flow 'volume_create_manager' (8435a694-e354-47b0-ae4a-118940d8e24f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:32:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3e123ec8-f7b8-45b8-96a9-f952930a4ae1 tempest-VolumeTypesAccessTest-1312484936 None] Created volume successfully.
Sep 18 13:32:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Acquiring lock "cinder-ef74e53a-5fbf-40f9-923b-22887838c7e2-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:32:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Lock "cinder-ef74e53a-5fbf-40f9-923b-22887838c7e2-delete_volume" acquired by "delete_volume" :: waited 0.143s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:32:08 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:32:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Acquiring lock "cinder-quobyte-ef74e53a-5fbf-40f9-923b-22887838c7e2" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:32:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Lock "cinder-quobyte-ef74e53a-5fbf-40f9-923b-22887838c7e2" acquired by "delete_volume" :: waited 0.029s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:32:08 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cebda2e-ba3f-4e9b-b3ef-90eca0afe64e]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:32:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ef74e53a-5fbf-40f9-923b-22887838c7e2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:32:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ef74e53a-5fbf-40f9-923b-22887838c7e2" returned: 0 in 0.828s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:32:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ef74e53a-5fbf-40f9-923b-22887838c7e2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:32:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ef74e53a-5fbf-40f9-923b-22887838c7e2" returned: 0 in 0.249s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:32:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Lock "cinder-quobyte-ef74e53a-5fbf-40f9-923b-22887838c7e2" released by "delete_volume" :: held 1.499s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:32:10 devstack cinder-volume[82799]: WARNING cinder.quota [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1000947217 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1000947217, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:32:10 devstack cinder-volume[82799]: WARNING cinder.quota [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1000947217 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1000947217, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:32:10 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Created reservations ['3eee02bf-f1cc-4b55-814e-ca9f40a0bce6', '12ff022e-079b-4ee8-b1f5-676ef4842885', 'f432ca1b-26b5-4630-b38e-7cd9d7922ba2', '137114fb-3b09-48b2-ace7-a8e72d0618fa'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:32:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:32:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:32:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:32:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:32:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:32:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:32:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.214s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:32:10 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:32:11 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Deleted volume successfully.
Sep 18 13:32:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d6ce277-bdda-45af-9364-b75edcc59117 tempest-VolumeTypesAccessTest-1312484936 None] Lock "cinder-ef74e53a-5fbf-40f9-923b-22887838c7e2-delete_volume" released by "delete_volume" :: held 4.290s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:32:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:32:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:32:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:32:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:32:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:32:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:32:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:32:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.401s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:32:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:32:20 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=42,cinder:SELECT=30,cinder:DELETE=6,cinder:INSERT=8 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:32:21 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=6,cinder:DELETE=2,cinder:SELECT=6,cinder:INSERT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:33:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:33:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:33:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:33:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:33:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:33:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:33:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:33:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.206s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:33:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:33:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:33:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:33:54 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Flow 'volume_create_manager' (277fa007-1d00-4222-bedd-03717ee77420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64fe770-d263-4a73-812a-7cf178688e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64fe770-d263-4a73-812a-7cf178688e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-399393152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38ccc70448b4872a557103f4c2a7aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:33:53Z,use_quota=True,user_id='560f7e0e5bde4b8689814d25f5dd119e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4e2e9a-b60e-48c5-bdc1-fbefb73e5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4e2e9a-b60e-48c5-bdc1-fbefb73e5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e48e22-2afa-42e1-b04b-6e70f6951019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e48e22-2afa-42e1-b04b-6e70f6951019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8', 'volume_name': 'volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52cf748-bdff-4cec-9b6f-81ba587340cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52cf748-bdff-4cec-9b6f-81ba587340cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adf52d5-2a5d-40ff-ae61-27b69d35bec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:54 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume 4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8', 'volume_size': 1}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:33:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:33:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-399393152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38ccc70448b4872a557103f4c2a7aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:33:53Z,use_quota=True,user_id='560f7e0e5bde4b8689814d25f5dd119e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:33:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Creating volume 4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:33:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:33:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:33:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:33:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:33:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:33:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:33:55 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:33:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:33:55 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=35, name=volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:33:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8 1073741824" returned: 0 in 1.013s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:33:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:33:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8" returned: 0 in 0.341s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:33:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] <== create_volume: return (1767ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:33:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:33:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adf52d5-2a5d-40ff-ae61-27b69d35bec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60aa1e5-4905-4cad-b62b-6ed317c31024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:57 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8 (4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8): created successfully
Sep 18 13:33:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60aa1e5-4905-4cad-b62b-6ed317c31024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Flow 'volume_create_manager' (277fa007-1d00-4222-bedd-03717ee77420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:33:57 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b9fb62e5-eb29-4b7e-87b0-ec23c353c3ae tempest-AttachVolumeShelveTestJSON-1618960657 None] Created volume successfully.
Sep 18 13:33:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (578baae6-aae7-4b12-92f4-ba8df6ed5ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d7ca33-611c-4f72-9ce5-c2d93d7a038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d7ca33-611c-4f72-9ce5-c2d93d7a038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-573932697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e9b6e8-1873-490a-8874-220bf02d2ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:33:59Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e46c5e4-d3b2-4503-97b2-06fe608d47bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e46c5e4-d3b2-4503-97b2-06fe608d47bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c1b515-3f1b-49ad-8ad5-69fa148adcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c1b515-3f1b-49ad-8ad5-69fa148adcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e9b6e8-1873-490a-8874-220bf02d2ccd', 'volume_name': 'volume-14e9b6e8-1873-490a-8874-220bf02d2ccd', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e42fe2a-8a19-441e-82eb-822501bb566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e42fe2a-8a19-441e-82eb-822501bb566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4ab85a-420c-476d-8ae9-ff243e933e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:33:59 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Volume 14e9b6e8-1873-490a-8874-220bf02d2ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e9b6e8-1873-490a-8874-220bf02d2ccd', 'volume_size': 1}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-573932697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e9b6e8-1873-490a-8874-220bf02d2ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:33:59Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Creating volume 14e9b6e8-1873-490a-8874-220bf02d2ccd {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:33:59 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:33:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-14e9b6e8-1873-490a-8874-220bf02d2ccd 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:33:59 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=36, name=volume-14e9b6e8-1873-490a-8874-220bf02d2ccd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:34:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-14e9b6e8-1873-490a-8874-220bf02d2ccd 1073741824" returned: 0 in 0.449s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-14e9b6e8-1873-490a-8874-220bf02d2ccd {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-14e9b6e8-1873-490a-8874-220bf02d2ccd" returned: 0 in 0.181s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] <== create_volume: return (733ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:34:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4ab85a-420c-476d-8ae9-ff243e933e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e9b6e8-1873-490a-8874-220bf02d2ccd', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e4ecce-be3e-4b6e-8a5f-9a5559087d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:01 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Volume volume-14e9b6e8-1873-490a-8874-220bf02d2ccd (14e9b6e8-1873-490a-8874-220bf02d2ccd): created successfully
Sep 18 13:34:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e4ecce-be3e-4b6e-8a5f-9a5559087d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (578baae6-aae7-4b12-92f4-ba8df6ed5ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:01 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1b464906-5b89-418a-82eb-9b019d70983c tempest-VolumesActionsTest-1841472576 None] Created volume successfully.
Sep 18 13:34:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1de531bb-87b8-4bf0-a6a7-6776d094e7db tempest-VolumesActionsTest-1841472576 None] Acquiring lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd" by "attach_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1de531bb-87b8-4bf0-a6a7-6776d094e7db tempest-VolumesActionsTest-1841472576 None] Lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd" acquired by "attach_volume" :: waited 0.101s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1de531bb-87b8-4bf0-a6a7-6776d094e7db tempest-VolumesActionsTest-1841472576 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:02 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1de531bb-87b8-4bf0-a6a7-6776d094e7db tempest-VolumesActionsTest-1841472576 None] Attaching volume 14e9b6e8-1873-490a-8874-220bf02d2ccd to instance 8ef26d07-fd71-484b-be90-83ef518abbbe at mountpoint /dev/vdb on host None.
Sep 18 13:34:02 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1de531bb-87b8-4bf0-a6a7-6776d094e7db tempest-VolumesActionsTest-1841472576 None] Attach volume completed successfully.
Sep 18 13:34:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1de531bb-87b8-4bf0-a6a7-6776d094e7db tempest-VolumesActionsTest-1841472576 None] Lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd" released by "attach_volume" :: held 0.540s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4c0d29d5-52bc-4356-a42b-14b909edaba9 tempest-VolumesActionsTest-461871716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:05 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4c0d29d5-52bc-4356-a42b-14b909edaba9 tempest-VolumesActionsTest-461871716 None] Terminate volume connection completed successfully.
Sep 18 13:34:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-4c0d29d5-52bc-4356-a42b-14b909edaba9 tempest-VolumesActionsTest-461871716 None] Acquiring lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd-detach_volume" by "detach_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-4c0d29d5-52bc-4356-a42b-14b909edaba9 tempest-VolumesActionsTest-461871716 None] Lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4c0d29d5-52bc-4356-a42b-14b909edaba9 tempest-VolumesActionsTest-461871716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:05 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4c0d29d5-52bc-4356-a42b-14b909edaba9 tempest-VolumesActionsTest-461871716 None] Detaching volume 14e9b6e8-1873-490a-8874-220bf02d2ccd from instance 8ef26d07-fd71-484b-be90-83ef518abbbe.
Sep 18 13:34:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4c0d29d5-52bc-4356-a42b-14b909edaba9 tempest-VolumesActionsTest-461871716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4c0d29d5-52bc-4356-a42b-14b909edaba9 tempest-VolumesActionsTest-461871716 None] Detach volume completed successfully.
Sep 18 13:34:06 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-4c0d29d5-52bc-4356-a42b-14b909edaba9 tempest-VolumesActionsTest-461871716 None] Lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd-detach_volume" released by "detach_volume" :: held 0.148s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:06 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0b90734-e49e-4884-a5db-7fee38199d8c tempest-VolumesActionsTest-1841472576 None] Acquiring lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd-detach_volume" by "detach_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:06 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0b90734-e49e-4884-a5db-7fee38199d8c tempest-VolumesActionsTest-1841472576 None] Lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c0b90734-e49e-4884-a5db-7fee38199d8c tempest-VolumesActionsTest-1841472576 None] Volume detach called, but volume not attached.
Sep 18 13:34:06 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0b90734-e49e-4884-a5db-7fee38199d8c tempest-VolumesActionsTest-1841472576 None] Lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:08 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "cinder-quobyte-14e9b6e8-1873-490a-8874-220bf02d2ccd" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Lock "cinder-quobyte-14e9b6e8-1873-490a-8874-220bf02d2ccd" acquired by "delete_volume" :: waited 0.036s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:08 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc195f-377d-4916-95ac-06dea4e8fd32]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:34:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-14e9b6e8-1873-490a-8874-220bf02d2ccd {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:08 devstack quobyte-client[82822]: System call of process 89640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:34:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-14e9b6e8-1873-490a-8874-220bf02d2ccd" returned: 0 in 0.573s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-14e9b6e8-1873-490a-8874-220bf02d2ccd {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-14e9b6e8-1873-490a-8874-220bf02d2ccd" returned: 0 in 0.144s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Lock "cinder-quobyte-14e9b6e8-1873-490a-8874-220bf02d2ccd" released by "delete_volume" :: held 1.108s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:09 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Created reservations ['beb9173b-a580-4b2f-9542-2fd4c0d35958', '391872ee-fe5d-4f04-b5a1-9fbce7edbd17', 'b39003ce-7bcd-4eca-ae74-264fd97fa471', '4701130f-bcb2-41e2-986f-c8f777b2a3dc'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:34:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.136s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:10 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:34:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Deleted volume successfully.
Sep 18 13:34:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-609e7d7f-cd95-42dc-8469-6b77993662f9 tempest-VolumesActionsTest-1841472576 None] Lock "cinder-14e9b6e8-1873-490a-8874-220bf02d2ccd-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:34:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.648s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:34:19 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=16,cinder:DELETE=1,cinder:SELECT=16,cinder:INSERT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:34:20 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (7c615b75-5045-4423-9cac-c32a94f250ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f395123-d601-4078-8e47-25a13e1a1e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f395123-d601-4078-8e47-25a13e1a1e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1269656662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7037825d-81eb-460b-8dfe-815fc57b0c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:20Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ba9c1e-4677-4e93-80f0-7ee2884d8cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ba9c1e-4677-4e93-80f0-7ee2884d8cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5a504a-7c0c-47f3-bc93-9655a15242a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5a504a-7c0c-47f3-bc93-9655a15242a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7037825d-81eb-460b-8dfe-815fc57b0c79', 'volume_name': 'volume-7037825d-81eb-460b-8dfe-815fc57b0c79', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c141611d-090c-4297-8ce4-f04be53c90d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c141611d-090c-4297-8ce4-f04be53c90d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b049a1c4-653c-4bdd-bc1c-70b31d381b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:20 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Volume 7037825d-81eb-460b-8dfe-815fc57b0c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7037825d-81eb-460b-8dfe-815fc57b0c79', 'volume_size': 1}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1269656662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7037825d-81eb-460b-8dfe-815fc57b0c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:20Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Creating volume 7037825d-81eb-460b-8dfe-815fc57b0c79 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:34:20 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:34:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7037825d-81eb-460b-8dfe-815fc57b0c79 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:21 devstack quobyte-client[82822]: System call of process 89740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:34:21 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=37, name=volume-7037825d-81eb-460b-8dfe-815fc57b0c79, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:34:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7037825d-81eb-460b-8dfe-815fc57b0c79 1073741824" returned: 0 in 0.599s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7037825d-81eb-460b-8dfe-815fc57b0c79 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7037825d-81eb-460b-8dfe-815fc57b0c79" returned: 0 in 0.193s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] <== create_volume: return (897ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:34:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b049a1c4-653c-4bdd-bc1c-70b31d381b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7037825d-81eb-460b-8dfe-815fc57b0c79', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58814c1a-9397-4f37-823c-41271353e2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:22 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Volume volume-7037825d-81eb-460b-8dfe-815fc57b0c79 (7037825d-81eb-460b-8dfe-815fc57b0c79): created successfully
Sep 18 13:34:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58814c1a-9397-4f37-823c-41271353e2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (7c615b75-5045-4423-9cac-c32a94f250ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:22 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-6a3180d8-e20a-407c-a0de-3cc97ea67d08 tempest-VolumesActionsTest-1841472576 None] Created volume successfully.
Sep 18 13:34:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Acquiring lock "cinder-7037825d-81eb-460b-8dfe-815fc57b0c79-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Lock "cinder-7037825d-81eb-460b-8dfe-815fc57b0c79-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:23 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Acquiring lock "cinder-quobyte-7037825d-81eb-460b-8dfe-815fc57b0c79" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Lock "cinder-quobyte-7037825d-81eb-460b-8dfe-815fc57b0c79" acquired by "delete_volume" :: waited 0.022s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:23 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f927c9b2-5c50-4273-9317-e583470e37d6]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:34:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7037825d-81eb-460b-8dfe-815fc57b0c79 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7037825d-81eb-460b-8dfe-815fc57b0c79" returned: 0 in 0.643s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7037825d-81eb-460b-8dfe-815fc57b0c79 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7037825d-81eb-460b-8dfe-815fc57b0c79" returned: 0 in 0.152s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Lock "cinder-quobyte-7037825d-81eb-460b-8dfe-815fc57b0c79" released by "delete_volume" :: held 1.005s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Created reservations ['c71b01b1-7882-4573-8d3a-0f8994861467', 'f112b308-8ad9-4b06-9bd4-1b8df700a56b', 'bfd721e9-c4df-41f2-bb08-194fbf792d81', 'f830e440-4cc4-4169-acea-4f23e9558478'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.111s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:25 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:34:25 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Deleted volume successfully.
Sep 18 13:34:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-44cbe981-8416-42c1-abb4-58ee5d6a1a16 tempest-VolumesActionsTest-461871716 None] Lock "cinder-7037825d-81eb-460b-8dfe-815fc57b0c79-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:26 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (7c2f940f-efef-4b4a-b54a-57762c1149a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79835e87-cb38-4f1d-9f8a-ad7f0fce1a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79835e87-cb38-4f1d-9f8a-ad7f0fce1a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-96103245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00a7971-4b5f-4e9f-904e-56d90b62c8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:26Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b00570c-78c5-495d-9e14-b2b4df9eab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b00570c-78c5-495d-9e14-b2b4df9eab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171e5cdd-8308-4102-8be6-c575542c0bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171e5cdd-8308-4102-8be6-c575542c0bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00a7971-4b5f-4e9f-904e-56d90b62c8e8', 'volume_name': 'volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44342462-0d07-45b7-b5d3-126f9c02f292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44342462-0d07-45b7-b5d3-126f9c02f292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8feef955-e521-48f3-8084-5745368d7c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:26 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Volume d00a7971-4b5f-4e9f-904e-56d90b62c8e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8', 'volume_size': 1}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-96103245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00a7971-4b5f-4e9f-904e-56d90b62c8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:26Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Creating volume d00a7971-4b5f-4e9f-904e-56d90b62c8e8 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:34:26 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:26 devstack quobyte-client[82822]: System call of process 89757 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:34:26 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=38, name=volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:34:26 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-5aff01e0-5cde-4cfc-9d4e-0c82eae165a5 req-056d88af-12e3-4225-8163-36ca461a017c tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:26 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-5aff01e0-5cde-4cfc-9d4e-0c82eae165a5 req-056d88af-12e3-4225-8163-36ca461a017c tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:26 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-5aff01e0-5cde-4cfc-9d4e-0c82eae165a5 req-056d88af-12e3-4225-8163-36ca461a017c tempest-AttachVolumeNegativeTest-182207659 None] Terminate volume connection completed successfully.
Sep 18 13:34:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-5aff01e0-5cde-4cfc-9d4e-0c82eae165a5 req-056d88af-12e3-4225-8163-36ca461a017c tempest-AttachVolumeNegativeTest-182207659 None] Deleting attachment 405f44be-28f5-46db-9b73-2482ab68db10. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:34:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8 1073741824" returned: 0 in 0.555s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8" returned: 0 in 0.122s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:34:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8feef955-e521-48f3-8084-5745368d7c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2148af-2727-412c-a0b2-5f5a8714ad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:27 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Volume volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8 (d00a7971-4b5f-4e9f-904e-56d90b62c8e8): created successfully
Sep 18 13:34:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2148af-2727-412c-a0b2-5f5a8714ad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (7c2f940f-efef-4b4a-b54a-57762c1149a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:27 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-791c4bdd-6b8b-4cb1-979b-ac5c583491d3 tempest-VolumesActionsTest-1841472576 None] Created volume successfully.
Sep 18 13:34:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cf95507e-864c-4413-9720-6deb1410bb37 req-df63502f-d4d8-452a-b4aa-151c7c0ec540 tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cf95507e-864c-4413-9720-6deb1410bb37 req-df63502f-d4d8-452a-b4aa-151c7c0ec540 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:28 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a02c6ee-cc2f-4101-83bd-2cb5d13c8834]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:34:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cf95507e-864c-4413-9720-6deb1410bb37 req-df63502f-d4d8-452a-b4aa-151c7c0ec540 tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:28 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Acquiring lock "cinder-d00a7971-4b5f-4e9f-904e-56d90b62c8e8-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:28 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Lock "cinder-d00a7971-4b5f-4e9f-904e-56d90b62c8e8-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:29 devstack quobyte-client[82822]: System call of process 89770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:34:29 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Acquiring lock "cinder-quobyte-d00a7971-4b5f-4e9f-904e-56d90b62c8e8" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cf95507e-864c-4413-9720-6deb1410bb37 req-df63502f-d4d8-452a-b4aa-151c7c0ec540 tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8" returned: 0 in 0.782s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cf95507e-864c-4413-9720-6deb1410bb37 req-df63502f-d4d8-452a-b4aa-151c7c0ec540 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Lock "cinder-quobyte-d00a7971-4b5f-4e9f-904e-56d90b62c8e8" acquired by "delete_volume" :: waited 0.073s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:29 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d08b637-354d-408d-bfaa-28d8643070c8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:34:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-cf95507e-864c-4413-9720-6deb1410bb37 req-df63502f-d4d8-452a-b4aa-151c7c0ec540 tempest-AttachVolumeShelveTestJSON-1618960657 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad151c61-5520-4f44-a51d-9357abd89f0a', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:34:29 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-cf95507e-864c-4413-9720-6deb1410bb37 req-df63502f-d4d8-452a-b4aa-151c7c0ec540 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:30 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-cf95507e-864c-4413-9720-6deb1410bb37 req-df63502f-d4d8-452a-b4aa-151c7c0ec540 tempest-AttachVolumeShelveTestJSON-1618960657 None] attachment_update completed successfully.
Sep 18 13:34:30 devstack quobyte-client[82822]: System call of process 89773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:34:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8" returned: 0 in 1.332s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d00a7971-4b5f-4e9f-904e-56d90b62c8e8" returned: 0 in 0.183s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Lock "cinder-quobyte-d00a7971-4b5f-4e9f-904e-56d90b62c8e8" released by "delete_volume" :: held 2.204s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:31 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Created reservations ['86207cbd-961e-4550-b18b-6c550c3bf605', 'eeb80f5f-b765-41f0-b726-61e562ef2782', '5a06bcc9-c0c4-496e-8fd7-30023a60f3f8', '6b597ac0-1a33-4cd3-8d39-e194d6f48c9f'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:34:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.083s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:32 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:34:32 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Deleted volume successfully.
Sep 18 13:34:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-effe7be2-5969-44c1-8b91-c086291bb07f tempest-VolumesActionsTest-461871716 None] Lock "cinder-d00a7971-4b5f-4e9f-904e-56d90b62c8e8-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:33 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (5b859b21-6def-4b99-b5b4-244dbf563587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a96630-01a5-45c1-998e-e1085e738137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a96630-01a5-45c1-998e-e1085e738137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1105076169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d78916-4913-4a27-8c92-312ca29fa379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:33Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260a12d6-7829-4691-8a39-6b6916cd5025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260a12d6-7829-4691-8a39-6b6916cd5025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f9d918-c5da-4702-8711-008a8b2ca3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f9d918-c5da-4702-8711-008a8b2ca3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d78916-4913-4a27-8c92-312ca29fa379', 'volume_name': 'volume-37d78916-4913-4a27-8c92-312ca29fa379', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256cbecd-71a6-4c77-90c8-821533b81a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256cbecd-71a6-4c77-90c8-821533b81a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98acd3f-7b4b-481d-9948-d985f764f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:33 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Volume 37d78916-4913-4a27-8c92-312ca29fa379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d78916-4913-4a27-8c92-312ca29fa379', 'volume_size': 1}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1105076169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d78916-4913-4a27-8c92-312ca29fa379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:33Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Creating volume 37d78916-4913-4a27-8c92-312ca29fa379 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:34:33 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:34:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-37d78916-4913-4a27-8c92-312ca29fa379 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:34 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=39, name=volume-37d78916-4913-4a27-8c92-312ca29fa379, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:34:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-37d78916-4913-4a27-8c92-312ca29fa379 1073741824" returned: 0 in 0.605s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-37d78916-4913-4a27-8c92-312ca29fa379 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-37d78916-4913-4a27-8c92-312ca29fa379" returned: 0 in 0.151s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] <== create_volume: return (886ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:34:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98acd3f-7b4b-481d-9948-d985f764f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d78916-4913-4a27-8c92-312ca29fa379', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59705429-b735-49b0-991d-0e2ba8fd0bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:35 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Volume volume-37d78916-4913-4a27-8c92-312ca29fa379 (37d78916-4913-4a27-8c92-312ca29fa379): created successfully
Sep 18 13:34:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59705429-b735-49b0-991d-0e2ba8fd0bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (5b859b21-6def-4b99-b5b4-244dbf563587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:35 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9fe1367d-ca00-41df-a3e3-9e324a743958 tempest-VolumesActionsTest-1841472576 None] Created volume successfully.
Sep 18 13:34:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Acquiring lock "cinder-37d78916-4913-4a27-8c92-312ca29fa379-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Lock "cinder-37d78916-4913-4a27-8c92-312ca29fa379-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:36 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Acquiring lock "cinder-quobyte-37d78916-4913-4a27-8c92-312ca29fa379" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Lock "cinder-quobyte-37d78916-4913-4a27-8c92-312ca29fa379" acquired by "delete_volume" :: waited 0.019s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:36 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed6d087-84f1-4882-9310-2bdee7132183]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:34:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-37d78916-4913-4a27-8c92-312ca29fa379 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-37d78916-4913-4a27-8c92-312ca29fa379" returned: 0 in 0.612s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-37d78916-4913-4a27-8c92-312ca29fa379 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-37d78916-4913-4a27-8c92-312ca29fa379" returned: 0 in 0.124s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Lock "cinder-quobyte-37d78916-4913-4a27-8c92-312ca29fa379" released by "delete_volume" :: held 1.021s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:37 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Created reservations ['e07bf937-8fd2-4413-a65d-46cc528babd1', '4405d337-b96e-4997-acf4-465de2515279', '0965af1c-af31-4566-a4df-6340bcc9e98c', 'f8994a25-aad7-431c-9af0-85da6850f0f7'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:34:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.202s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:38 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:34:38 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Deleted volume successfully.
Sep 18 13:34:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ad23a8b8-eca0-4bba-84eb-527696e5285f tempest-VolumesActionsTest-461871716 None] Lock "cinder-37d78916-4913-4a27-8c92-312ca29fa379-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:39 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (7904d774-1c46-4a73-a439-f7a0e3a7091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1946cb-2556-459f-9f59-3c6f5e3d2531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1946cb-2556-459f-9f59-3c6f5e3d2531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1517415157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08764bf2-2153-4dad-8485-3f8b5fa4e6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:39Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d6dc05-0a89-4b95-92dd-4d326150c66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d6dc05-0a89-4b95-92dd-4d326150c66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da20fd97-8b44-4149-b2ca-3f02a264cb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da20fd97-8b44-4149-b2ca-3f02a264cb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08764bf2-2153-4dad-8485-3f8b5fa4e6bc', 'volume_name': 'volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7447f68-77e9-4b1e-b51c-f4a206e6ff24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7447f68-77e9-4b1e-b51c-f4a206e6ff24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c92b8f9-1eba-4f94-9487-4785949cf718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:39 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Volume 08764bf2-2153-4dad-8485-3f8b5fa4e6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc', 'volume_size': 1}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1517415157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08764bf2-2153-4dad-8485-3f8b5fa4e6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:39Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Creating volume 08764bf2-2153-4dad-8485-3f8b5fa4e6bc {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:34:39 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:39 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=40, name=volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc 1073741824" returned: 0 in 0.558s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc" returned: 0 in 0.125s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] <== create_volume: return (812ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:34:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c92b8f9-1eba-4f94-9487-4785949cf718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a36564-b5ad-4127-b883-435831c4d3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:40 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Volume volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc (08764bf2-2153-4dad-8485-3f8b5fa4e6bc): created successfully
Sep 18 13:34:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a36564-b5ad-4127-b883-435831c4d3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (7904d774-1c46-4a73-a439-f7a0e3a7091e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:40 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8a022069-3750-4919-8f60-3a704f87cff8 tempest-VolumesActionsTest-1841472576 None] Created volume successfully.
Sep 18 13:34:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Acquiring lock "cinder-08764bf2-2153-4dad-8485-3f8b5fa4e6bc-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Lock "cinder-08764bf2-2153-4dad-8485-3f8b5fa4e6bc-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:42 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Acquiring lock "cinder-quobyte-08764bf2-2153-4dad-8485-3f8b5fa4e6bc" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Lock "cinder-quobyte-08764bf2-2153-4dad-8485-3f8b5fa4e6bc" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:42 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa074048-54b2-4a73-9b67-1ad4887bd02b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:34:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc" returned: 0 in 0.404s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-08764bf2-2153-4dad-8485-3f8b5fa4e6bc" returned: 0 in 0.146s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Lock "cinder-quobyte-08764bf2-2153-4dad-8485-3f8b5fa4e6bc" released by "delete_volume" :: held 0.801s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:43 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Created reservations ['66aa8713-a379-4f67-b357-54d94aec47c1', '182d61cd-a091-419f-8895-da25ad3075f0', 'd1e7e91b-0a06-4fc9-9f6d-3c87fea5e690', '1e1d03e8-51b4-48d9-811d-86abfae40d1f'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:34:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.159s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:44 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:34:44 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Deleted volume successfully.
Sep 18 13:34:44 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-eea167b9-170a-4fef-93a1-95c73b86bf5f tempest-VolumesActionsTest-461871716 None] Lock "cinder-08764bf2-2153-4dad-8485-3f8b5fa4e6bc-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:45 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (02838d45-2ae2-4dc0-a557-bb7854c66e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29aabf34-b8d4-4f8e-9266-4b9b0c861083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29aabf34-b8d4-4f8e-9266-4b9b0c861083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-369956266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b3394e-21eb-4012-847a-5b0c668e02ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:45Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281a4bca-be89-4ccb-adf1-acf96fdb4174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281a4bca-be89-4ccb-adf1-acf96fdb4174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edc3399-8a86-4057-8852-88631c859e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edc3399-8a86-4057-8852-88631c859e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b3394e-21eb-4012-847a-5b0c668e02ad', 'volume_name': 'volume-21b3394e-21eb-4012-847a-5b0c668e02ad', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a44c4f-c4dd-440d-b509-86d917b30142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a44c4f-c4dd-440d-b509-86d917b30142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37865670-6aa6-414b-914a-61e1c6e37511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:45 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Volume 21b3394e-21eb-4012-847a-5b0c668e02ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b3394e-21eb-4012-847a-5b0c668e02ad', 'volume_size': 1}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-369956266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b3394e-21eb-4012-847a-5b0c668e02ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14290b7bbf604a97afe5122573da2fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:34:45Z,use_quota=True,user_id='ce19e940f89247dabab797bb278df5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Creating volume 21b3394e-21eb-4012-847a-5b0c668e02ad {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:34:45 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:34:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-21b3394e-21eb-4012-847a-5b0c668e02ad 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:45 devstack quobyte-client[82822]: System call of process 89860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:34:46 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=41, name=volume-21b3394e-21eb-4012-847a-5b0c668e02ad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:34:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-21b3394e-21eb-4012-847a-5b0c668e02ad 1073741824" returned: 0 in 0.467s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-21b3394e-21eb-4012-847a-5b0c668e02ad {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-21b3394e-21eb-4012-847a-5b0c668e02ad" returned: 0 in 0.096s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] <== create_volume: return (711ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:34:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37865670-6aa6-414b-914a-61e1c6e37511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b3394e-21eb-4012-847a-5b0c668e02ad', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdd6c05-b826-4990-b400-a541d4d601df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:34:46 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Volume volume-21b3394e-21eb-4012-847a-5b0c668e02ad (21b3394e-21eb-4012-847a-5b0c668e02ad): created successfully
Sep 18 13:34:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdd6c05-b826-4990-b400-a541d4d601df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:34:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Flow 'volume_create_manager' (02838d45-2ae2-4dc0-a557-bb7854c66e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:34:46 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-14c718cc-ebe1-4e36-a583-4a07ac66671a tempest-VolumesActionsTest-1841472576 None] Created volume successfully.
Sep 18 13:34:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "cinder-21b3394e-21eb-4012-847a-5b0c668e02ad-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Lock "cinder-21b3394e-21eb-4012-847a-5b0c668e02ad-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:48 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=44,cinder:UPDATE=58,cinder:DELETE=5,cinder:INSERT=14 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:34:48 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:34:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "cinder-quobyte-21b3394e-21eb-4012-847a-5b0c668e02ad" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:34:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Lock "cinder-quobyte-21b3394e-21eb-4012-847a-5b0c668e02ad" acquired by "delete_volume" :: waited 0.029s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:34:49 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bf8990-b4cd-4a42-9ae2-0dd4c38fd2f3]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:34:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-21b3394e-21eb-4012-847a-5b0c668e02ad {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-21b3394e-21eb-4012-847a-5b0c668e02ad" returned: 0 in 0.812s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-21b3394e-21eb-4012-847a-5b0c668e02ad {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-21b3394e-21eb-4012-847a-5b0c668e02ad" returned: 0 in 0.145s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Lock "cinder-quobyte-21b3394e-21eb-4012-847a-5b0c668e02ad" released by "delete_volume" :: held 1.218s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Created reservations ['5a7e9237-1cc8-4ec1-8ef9-43b7c012405f', '3465b8ee-7039-4dc7-88e8-e2217861ecf7', '59273945-6399-41b6-bccf-372d9800bae2', '6dab6a1f-d5a3-43e1-8751-27e34922b62f'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:34:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.107s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:34:51 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:34:51 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Deleted volume successfully.
Sep 18 13:34:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3a4f484d-8958-4613-9b42-725e40c9cce4 tempest-VolumesActionsTest-1841472576 None] Lock "cinder-21b3394e-21eb-4012-847a-5b0c668e02ad-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:35:00 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=36,cinder:UPDATE=53,cinder:DELETE=6,cinder:INSERT=9 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:35:01 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:35:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:35:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:35:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.043s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:35:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:35:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:35:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:35:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.491s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:35:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:35:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:35:37 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Flow 'volume_create_manager' (3f1343b1-91c4-4b3c-8333-5b3de47dba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dad819-727d-49d3-93fb-1c29b7374f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dad819-727d-49d3-93fb-1c29b7374f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-607289018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51d15fd-e890-44f6-9c5e-5f5f0b287152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e110e8c9683b408fac86e4ee2df3c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:35:37Z,use_quota=True,user_id='56910921634649df8bbb1a5a26a5013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bd3fc4-869b-4e01-94c5-205d1b6a542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bd3fc4-869b-4e01-94c5-205d1b6a542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929b35ee-bb76-4920-9c68-6808a2dd258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929b35ee-bb76-4920-9c68-6808a2dd258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e51d15fd-e890-44f6-9c5e-5f5f0b287152', 'volume_name': 'volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60146dff-7b35-4309-95af-b18df2f84742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60146dff-7b35-4309-95af-b18df2f84742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4ac1ea-83e2-45ab-923a-859c935ba0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:35:37 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Volume e51d15fd-e890-44f6-9c5e-5f5f0b287152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152', 'volume_size': 1}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-607289018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51d15fd-e890-44f6-9c5e-5f5f0b287152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e110e8c9683b408fac86e4ee2df3c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:35:37Z,use_quota=True,user_id='56910921634649df8bbb1a5a26a5013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Creating volume e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:35:37 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:35:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:38 devstack quobyte-client[82822]: System call of process 90551 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:35:38 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=42, name=volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:35:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 1073741824" returned: 0 in 0.603s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152" returned: 0 in 0.246s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] <== create_volume: return (1062ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:35:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:35:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4ac1ea-83e2-45ab-923a-859c935ba0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:35:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e851ee9-124d-4a1d-b5d6-3f87ebe865e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:35:39 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Volume volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 (e51d15fd-e890-44f6-9c5e-5f5f0b287152): created successfully
Sep 18 13:35:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e851ee9-124d-4a1d-b5d6-3f87ebe865e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:35:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Flow 'volume_create_manager' (3f1343b1-91c4-4b3c-8333-5b3de47dba52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:35:39 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-6a964b18-202e-4015-a876-67747596c2b2 tempest-VolumesDeleteCascade-1722954074 None] Created volume successfully.
Sep 18 13:35:41 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:35:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:35:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:35:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Creating offline snapshot 05b9603d-db0e-428d-b036-2788a34dc14d of volume e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:35:41 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c782e9a9-f522-4e1c-998b-6521ba64a47c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:41 devstack quobyte-client[82822]: System call of process 90557 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:35:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152" returned: 0 in 0.675s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:42 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=43, name=volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:35:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d 1G" returned: 0 in 0.525s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:42 devstack quobyte-client[82822]: System call of process 90563 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:35:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img rebase -u -b volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d" returned: 0 in 0.201s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:35:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d" returned: 0 in 0.132s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d" returned: 0 in 0.127s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.info" returned: 0 in 0.165s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.info" returned: 0 in 0.237s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.679s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:35:44 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-396e2fc5-a869-467f-a23c-89b0d55437b6 tempest-VolumesDeleteCascade-1722954074 None] Create snapshot completed successfully
Sep 18 13:35:45 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:35:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:35:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:35:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Creating offline snapshot 1528e917-f4dc-4858-84de-fe65bfe63495 of volume e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:35:46 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ecc887-1a0d-4f1e-8146-1b450b8b31a8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d" returned: 0 in 0.793s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:35:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:47 devstack quobyte-client[82822]: System call of process 90574 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:35:47 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=45, name=volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:35:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 1G" returned: 0 in 0.621s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img rebase -u -b volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495" returned: 0 in 0.242s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:35:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495" returned: 0 in 0.155s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:35:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495" returned: 0 in 0.164s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:35:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8bdb5614-1cb5-4c58-a6d3-fe59d40e9308 tempest-VolumesDeleteCascade-1722954074 None] Create snapshot completed successfully
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-e51d15fd-e890-44f6-9c5e-5f5f0b287152-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-e51d15fd-e890-44f6-9c5e-5f5f0b287152-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:35:49 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Performing cascade delete. {{(pid=82799) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-05b9603d-db0e-428d-b036-2788a34dc14d-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-05b9603d-db0e-428d-b036-2788a34dc14d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:35:49 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-e51d15fd-e890-44f6-9c5e-5f5f0b287152" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-e51d15fd-e890-44f6-9c5e-5f5f0b287152" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-05b9603d-db0e-428d-b036-2788a34dc14d" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-05b9603d-db0e-428d-b036-2788a34dc14d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Deleting offline snapshot 05b9603d-db0e-428d-b036-2788a34dc14d of volume e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] snapshot_file for this snap is: volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[84131de8-2ccf-4bcc-bd5b-a0bb2819e4e2]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d" returned: 0 in 0.801s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:35:50 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[391eb368-138f-49ff-8daa-d721b99b598c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152" returned: 0 in 0.555s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:51 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b016cd25-68fb-4c1b-a6ac-9cea3184c8c5]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:52 devstack quobyte-client[82822]: System call of process 90590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:35:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495" returned: 0 in 0.607s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:35:52 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd1637a-0653-4c7b-b93a-2c4601077261]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d" returned: 0 in 0.458s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:35:52 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fd2e93-8bfd-4dfc-9976-d2c605ac1407]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152" returned: 0 in 0.539s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d" returned: 0 in 0.293s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.05b9603d-db0e-428d-b036-2788a34dc14d" returned: 0 in 0.137s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 -F qcow2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:53 devstack quobyte-client[82822]: System call of process 90603 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img rebase -u -b volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 -F qcow2" returned: 0 in 0.261s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-05b9603d-db0e-428d-b036-2788a34dc14d" released by "_delete_snapshot" :: held 4.367s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-e51d15fd-e890-44f6-9c5e-5f5f0b287152" released by "delete_snapshot" :: held 4.423s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Created reservations ['8188b6f2-5a06-46c3-a742-fd17526befc4', '073c283a-3b5d-4f2d-a234-ebb0c4570dbf', '5d1ea2cd-4249-4c36-b67a-f5170980cc4f', 'dd95b08e-ac18-4a40-8973-d0ec812d9331'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:35:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Delete snapshot completed successfully.
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-05b9603d-db0e-428d-b036-2788a34dc14d-delete_snapshot" released by "delete_snapshot" :: held 5.080s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-1528e917-f4dc-4858-84de-fe65bfe63495-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-1528e917-f4dc-4858-84de-fe65bfe63495-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:35:54 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-e51d15fd-e890-44f6-9c5e-5f5f0b287152" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-e51d15fd-e890-44f6-9c5e-5f5f0b287152" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-1528e917-f4dc-4858-84de-fe65bfe63495" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-1528e917-f4dc-4858-84de-fe65bfe63495" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Deleting offline snapshot 1528e917-f4dc-4858-84de-fe65bfe63495 of volume e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] snapshot_file for this snap is: volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03a9533-9814-4b8f-9fc8-5e177cf81eaf]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495" returned: 0 in 0.506s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:35:55 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cd636f-4ef6-4998-b845-595098cfb6ff]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152" returned: 0 in 0.482s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495" returned: 0 in 0.276s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152.1528e917-f4dc-4858-84de-fe65bfe63495" returned: 0 in 0.124s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:56 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-1528e917-f4dc-4858-84de-fe65bfe63495" released by "_delete_snapshot" :: held 1.794s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:35:56 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-e51d15fd-e890-44f6-9c5e-5f5f0b287152" released by "delete_snapshot" :: held 1.824s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:35:57 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Created reservations ['0a669dad-bab4-4d62-940d-48419711e741', '98d2551f-3d83-4a2d-be06-c3c377e0a672', 'a636531d-1c31-4ef8-961a-775abe286ca2', '2ba0ac4e-bf23-4e8e-8bbd-ed9503e0cf20'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:35:57 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Delete snapshot completed successfully.
Sep 18 13:35:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-1528e917-f4dc-4858-84de-fe65bfe63495-delete_snapshot" released by "delete_snapshot" :: held 2.469s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:35:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Snapshots deleted, issuing volume delete {{(pid=82799) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 18 13:35:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-e51d15fd-e890-44f6-9c5e-5f5f0b287152" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:35:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-e51d15fd-e890-44f6-9c5e-5f5f0b287152" acquired by "delete_volume" :: waited 0.037s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:35:57 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2808b6-d749-4b90-a5f8-be144d577dc2]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:35:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152" returned: 0 in 0.687s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e51d15fd-e890-44f6-9c5e-5f5f0b287152" returned: 0 in 0.130s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:58 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-e51d15fd-e890-44f6-9c5e-5f5f0b287152" released by "delete_volume" :: held 1.035s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:35:58 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Created reservations ['f62b5543-d25b-46ca-b191-4350faafbb90', 'c7faf794-297a-4282-a871-68a44a7509ba', '738e3533-8711-47f0-921e-1a73ad2ff1dd', '6de0b251-49aa-4c56-854a-030bc3a3f38d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:35:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:35:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:35:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:35:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:35:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:35:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:35:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.138s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:35:59 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:35:59 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Deleted volume successfully.
Sep 18 13:35:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41ef389d-3ad5-493e-b12b-53bc7c2a6f7c tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-e51d15fd-e890-44f6-9c5e-5f5f0b287152-delete_volume" released by "delete_volume" :: held 10.200s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:01 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Flow 'volume_create_manager' (ec78af5a-8cc3-4bef-8a9a-f0c517a4e930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962a0bfc-fa02-46f0-a83b-dc3d8ae8fe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962a0bfc-fa02-46f0-a83b-dc3d8ae8fe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1475549669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15ae107-1e54-4449-a1e8-8c36cf9c02cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e110e8c9683b408fac86e4ee2df3c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:36:01Z,use_quota=True,user_id='56910921634649df8bbb1a5a26a5013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c369b1ac-2dfc-4029-89bc-87837ffe6f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c369b1ac-2dfc-4029-89bc-87837ffe6f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46334d-0156-4de8-b109-72510927e25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46334d-0156-4de8-b109-72510927e25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15ae107-1e54-4449-a1e8-8c36cf9c02cc', 'volume_name': 'volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ff1dfd-b28e-4d72-be95-14de9b61177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ff1dfd-b28e-4d72-be95-14de9b61177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1f46d5-12a7-4ab7-b41b-eeed46ff75ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:01 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Volume f15ae107-1e54-4449-a1e8-8c36cf9c02cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc', 'volume_size': 1}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1475549669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15ae107-1e54-4449-a1e8-8c36cf9c02cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e110e8c9683b408fac86e4ee2df3c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:36:01Z,use_quota=True,user_id='56910921634649df8bbb1a5a26a5013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Creating volume f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:36:01 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:36:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:01 devstack quobyte-client[82822]: System call of process 90670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:01 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=46, name=volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:36:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc 1073741824" returned: 0 in 0.486s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" returned: 0 in 0.122s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] <== create_volume: return (733ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:36:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1f46d5-12a7-4ab7-b41b-eeed46ff75ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44c6c9d-afac-46b9-9f50-08ef1c7a6d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:02 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Volume volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc (f15ae107-1e54-4449-a1e8-8c36cf9c02cc): created successfully
Sep 18 13:36:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44c6c9d-afac-46b9-9f50-08ef1c7a6d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Flow 'volume_create_manager' (ec78af5a-8cc3-4bef-8a9a-f0c517a4e930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:36:02 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c6b314c8-9481-424c-ac73-2a2aa3d70d08 tempest-VolumesDeleteCascade-1722954074 None] Created volume successfully.
Sep 18 13:36:03 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Creating offline snapshot 964c1002-466f-42ff-855e-e0b77136d815 of volume f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:36:03 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a645d9-41d1-462c-ba3c-d764b0d5c7c7]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" returned: 0 in 0.652s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:04 devstack quobyte-client[82822]: System call of process 90677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:04 devstack quobyte-client[82822]: System call of process 90677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:04 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=47, name=volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 1G" returned: 0 in 0.385s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img rebase -u -b volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815" returned: 0 in 0.203s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815" returned: 0 in 0.116s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815" returned: 0 in 0.128s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.info" returned: 0 in 0.157s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:36:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.info" returned: 0 in 0.122s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3af5a498-5afb-4281-9207-b7f42ba58d06 tempest-VolumesDeleteCascade-1722954074 None] Create snapshot completed successfully
Sep 18 13:36:07 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Flow 'volume_create_manager' (5a650c4a-d496-4c5d-b975-6bf24596bafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95ca8e4-b417-4f29-a607-337dac3ae320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95ca8e4-b417-4f29-a607-337dac3ae320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-807793566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e0d939-e59f-41e1-a165-5c6186fc54b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e110e8c9683b408fac86e4ee2df3c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=964c1002-466f-42ff-855e-e0b77136d815,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:36:07Z,use_quota=True,user_id='56910921634649df8bbb1a5a26a5013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73604ff1-a53e-4f04-b5b3-8545fe9baaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73604ff1-a53e-4f04-b5b3-8545fe9baaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2a82d2-f0cd-4438-935a-349300710689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2a82d2-f0cd-4438-935a-349300710689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5e0d939-e59f-41e1-a165-5c6186fc54b1', 'volume_name': 'volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1', 'volume_size': 1, 'snapshot_id': '964c1002-466f-42ff-855e-e0b77136d815'}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad26ac18-bfe1-4f8b-a15a-1dec2b3ba9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad26ac18-bfe1-4f8b-a15a-1dec2b3ba9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d75072-2178-4d9d-af1d-5b10909e23f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:07 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Volume a5e0d939-e59f-41e1-a165-5c6186fc54b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1', 'volume_size': 1, 'snapshot_id': '964c1002-466f-42ff-855e-e0b77136d815'}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-964c1002-466f-42ff-855e-e0b77136d815-a5e0d939-e59f-41e1-a165-5c6186fc54b1" by "_create_volume_from_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-964c1002-466f-42ff-855e-e0b77136d815-a5e0d939-e59f-41e1-a165-5c6186fc54b1" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Creating volume a5e0d939-e59f-41e1-a165-5c6186fc54b1 from snapshot 964c1002-466f-42ff-855e-e0b77136d815 {{(pid=82799) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-a5e0d939-e59f-41e1-a165-5c6186fc54b1" by "_copy_volume_from_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-a5e0d939-e59f-41e1-a165-5c6186fc54b1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] snapshot: 964c1002-466f-42ff-855e-e0b77136d815, volume: a5e0d939-e59f-41e1-a165-5c6186fc54b1,  {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f579c6-6e9f-4fd5-94c6-fb7f061959fb]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815" returned: 0 in 0.587s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:36:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] will copy from snapshot at /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 13:36:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Creating direct copy from snapshot {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 13:36:08 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68c11e9-c2f2-400e-80d7-955cbf5270ce]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" returned: 0 in 0.480s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:09 devstack cinder-volume[82799]: DEBUG cinder.utils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1 not found in is_blk_device check {{(pid=82799) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 13:36:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:09 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=49, name=volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:36:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:36:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:36:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:36:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.416s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:36:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1" returned: 0 in 6.984s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:16 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f29fb-9d86-4c06-b70f-0d062ee4575d]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" returned: 0 in 0.542s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:16 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Image conversion details: src /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1 {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:36:16 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Converted 1024.00 MB image at 146.38 MB/s
Sep 18 13:36:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:36:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1" returned: 0 in 0.100s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-a5e0d939-e59f-41e1-a165-5c6186fc54b1" released by "_copy_volume_from_snapshot" :: held 9.088s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-964c1002-466f-42ff-855e-e0b77136d815-a5e0d939-e59f-41e1-a165-5c6186fc54b1" released by "_create_volume_from_snapshot" :: held 9.132s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.159s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d75072-2178-4d9d-af1d-5b10909e23f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1', 'volume_size': 1, 'snapshot_id': '964c1002-466f-42ff-855e-e0b77136d815'}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5357ca7-2ff2-4db3-a95e-e3b8aff94f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:17 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Volume volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1 (a5e0d939-e59f-41e1-a165-5c6186fc54b1): created successfully
Sep 18 13:36:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5357ca7-2ff2-4db3-a95e-e3b8aff94f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Flow 'volume_create_manager' (5a650c4a-d496-4c5d-b975-6bf24596bafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:36:17 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e4c7cd27-081a-4ace-b54f-6aae46355265 tempest-VolumesDeleteCascade-1722954074 None] Created volume successfully.
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-f15ae107-1e54-4449-a1e8-8c36cf9c02cc-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-f15ae107-1e54-4449-a1e8-8c36cf9c02cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:18 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Performing cascade delete. {{(pid=82799) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-964c1002-466f-42ff-855e-e0b77136d815-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-964c1002-466f-42ff-855e-e0b77136d815-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:18 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-964c1002-466f-42ff-855e-e0b77136d815" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-964c1002-466f-42ff-855e-e0b77136d815" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Deleting offline snapshot 964c1002-466f-42ff-855e-e0b77136d815 of volume f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] snapshot_file for this snap is: volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[586d1571-039e-47bd-8903-94c33d4ff47f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:19 devstack quobyte-client[82822]: System call of process 90713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815" returned: 0 in 0.515s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:36:19 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae6997d-e21a-4366-8c33-adc00a8a6f6b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:20 devstack quobyte-client[82822]: System call of process 90720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" returned: 0 in 1.135s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:21 devstack quobyte-client[82822]: System call of process 90751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815" returned: 0 in 0.726s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc.964c1002-466f-42ff-855e-e0b77136d815" returned: 0 in 0.164s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-964c1002-466f-42ff-855e-e0b77136d815" released by "_delete_snapshot" :: held 3.051s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" released by "delete_snapshot" :: held 3.083s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:22 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Created reservations ['42a7e245-dc4e-4c88-886c-a4a5b23821e9', '062c6218-19c4-455c-af62-694809e60f44', 'e7122843-591f-48ca-86ec-60ddadf9a21b', 'daa4ba28-89cb-45a0-bd8e-b9cf73eb653f'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:36:22 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Delete snapshot completed successfully.
Sep 18 13:36:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-964c1002-466f-42ff-855e-e0b77136d815-delete_snapshot" released by "delete_snapshot" :: held 3.662s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Snapshots deleted, issuing volume delete {{(pid=82799) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 18 13:36:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" acquired by "delete_volume" :: waited 0.022s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:22 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e4bea3-7141-48f2-9a93-34f83223bb71]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:23 devstack quobyte-client[82822]: System call of process 90763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" returned: 0 in 0.850s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" returned: 0 in 0.197s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-f15ae107-1e54-4449-a1e8-8c36cf9c02cc" released by "delete_volume" :: held 1.396s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:24 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Created reservations ['c1eb4ba0-bfe7-42f5-9302-b2d0c23ae996', 'aeb32f79-4933-483b-a5ab-6b646a45942d', 'c3f9a067-d852-4d3f-bc64-e335e3eccf2f', 'd6924321-4f5e-4e9e-80b4-4d2e688a3b29'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:36:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:36:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:36:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.228s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:25 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:36:25 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Deleted volume successfully.
Sep 18 13:36:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-a5e0d939-e59f-41e1-a165-5c6186fc54b1-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3bfe01e8-5c0f-4914-a35b-0da3cb6a32fb tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-f15ae107-1e54-4449-a1e8-8c36cf9c02cc-delete_volume" released by "delete_volume" :: held 6.961s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-a5e0d939-e59f-41e1-a165-5c6186fc54b1-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:25 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "cinder-quobyte-a5e0d939-e59f-41e1-a165-5c6186fc54b1" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-a5e0d939-e59f-41e1-a165-5c6186fc54b1" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:25 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cb80a0-fe79-4508-abd2-0534888f5db8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:26 devstack quobyte-client[82822]: System call of process 90791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1" returned: 0 in 0.906s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a5e0d939-e59f-41e1-a165-5c6186fc54b1" returned: 0 in 0.194s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-quobyte-a5e0d939-e59f-41e1-a165-5c6186fc54b1" released by "delete_volume" :: held 1.318s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=36,cinder:UPDATE=41,cinder:DELETE=4,cinder:INSERT=16 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Created reservations ['9a330120-a962-4440-bc91-840dc92ae179', 'efb75aea-11b1-4052-9834-3a0cea1152f1', 'b92e740f-fee5-44d2-8f18-0b25d59ac891', '2668f714-2b60-4c32-903b-5265c9cf2adc'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.321s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:28 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:36:28 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Deleted volume successfully.
Sep 18 13:36:29 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=50,cinder:SELECT=41,cinder:DELETE=5,cinder:INSERT=8 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:36:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-49622b0b-1223-4520-afc9-6f63ae5f1794 tempest-VolumesDeleteCascade-1722954074 None] Lock "cinder-a5e0d939-e59f-41e1-a165-5c6186fc54b1-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:33 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Flow 'volume_create_manager' (ddc3695e-7a0c-4b75-8254-5a737a500fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791f0705-e644-48c9-8b1f-9de2c5579d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791f0705-e644-48c9-8b1f-9de2c5579d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1614597199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e473699d-d06b-4ced-89ab-d9e0c1d3c48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7890ea21cebe4bcc97ebe47c45a9694c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:36:33Z,use_quota=True,user_id='36a996126b084825908de659999eefcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558b8bf9-72c0-4a12-be26-8ad8e92d8618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558b8bf9-72c0-4a12-be26-8ad8e92d8618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfcb23e-528c-42a4-8091-7f6b0309c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfcb23e-528c-42a4-8091-7f6b0309c757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e473699d-d06b-4ced-89ab-d9e0c1d3c48c', 'volume_name': 'volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57859dd0-be03-453e-8d7d-97ee71c68e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57859dd0-be03-453e-8d7d-97ee71c68e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59067056-3946-4dae-a8c4-c446a8c16e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:33 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Volume e473699d-d06b-4ced-89ab-d9e0c1d3c48c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c', 'volume_size': 1}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1614597199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e473699d-d06b-4ced-89ab-d9e0c1d3c48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7890ea21cebe4bcc97ebe47c45a9694c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:36:33Z,use_quota=True,user_id='36a996126b084825908de659999eefcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Creating volume e473699d-d06b-4ced-89ab-d9e0c1d3c48c {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:36:33 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:36:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:33 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=50, name=volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:36:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c 1073741824" returned: 0 in 0.435s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c" returned: 0 in 0.187s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] <== create_volume: return (705ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:36:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59067056-3946-4dae-a8c4-c446a8c16e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67140cc3-6a1d-41ea-a24a-002a92be090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:34 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Volume volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c (e473699d-d06b-4ced-89ab-d9e0c1d3c48c): created successfully
Sep 18 13:36:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67140cc3-6a1d-41ea-a24a-002a92be090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Flow 'volume_create_manager' (ddc3695e-7a0c-4b75-8254-5a737a500fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:36:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8de57381-9e8e-44b9-ac70-3dccafbcb48c tempest-VolumesMetadataTest-1985940859 None] Created volume successfully.
Sep 18 13:36:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Acquiring lock "cinder-e473699d-d06b-4ced-89ab-d9e0c1d3c48c-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Lock "cinder-e473699d-d06b-4ced-89ab-d9e0c1d3c48c-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:37 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Acquiring lock "cinder-quobyte-e473699d-d06b-4ced-89ab-d9e0c1d3c48c" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:36:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Lock "cinder-quobyte-e473699d-d06b-4ced-89ab-d9e0c1d3c48c" acquired by "delete_volume" :: waited 0.038s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:36:37 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda6a00-3db1-41d4-9bc5-02f89e3e3fb5]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:39 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:36:39 devstack quobyte-client[82822]: System call of process 90822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Flow 'volume_create_manager' (85fad14b-624c-4cd2-81fe-d1dfcf084f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71da2c97-a330-44ac-981d-d1973fb31b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c" returned: 0 in 1.617s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71da2c97-a330-44ac-981d-d1973fb31b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-191647280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27b4663-9908-4360-a4e4-68a8643f9488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc136a134457439f9a11aad3687874f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:36:38Z,use_quota=True,user_id='646839e62e6042bea92e1762f9f54028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db639fc7-7e1d-4dd5-a6a8-cf8e11af3644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db639fc7-7e1d-4dd5-a6a8-cf8e11af3644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867e34a0-e27c-40c9-a416-5c53774e84b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867e34a0-e27c-40c9-a416-5c53774e84b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f27b4663-9908-4360-a4e4-68a8643f9488', 'volume_name': 'volume-f27b4663-9908-4360-a4e4-68a8643f9488', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b7bacc-8c74-412e-91db-21e684e46700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b7bacc-8c74-412e-91db-21e684e46700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356cfc15-44eb-47ed-9668-22ea469f93cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:40 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Volume f27b4663-9908-4360-a4e4-68a8643f9488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f27b4663-9908-4360-a4e4-68a8643f9488', 'volume_size': 1}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-191647280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27b4663-9908-4360-a4e4-68a8643f9488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc136a134457439f9a11aad3687874f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:36:38Z,use_quota=True,user_id='646839e62e6042bea92e1762f9f54028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Creating volume f27b4663-9908-4360-a4e4-68a8643f9488 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:36:40 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:40 devstack quobyte-client[82822]: System call of process 90842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e473699d-d06b-4ced-89ab-d9e0c1d3c48c" returned: 0 in 0.840s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:40 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=51, name=volume-f27b4663-9908-4360-a4e4-68a8643f9488, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:36:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Lock "cinder-quobyte-e473699d-d06b-4ced-89ab-d9e0c1d3c48c" released by "delete_volume" :: held 2.795s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488 1073741824" returned: 0 in 0.982s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488" returned: 0 in 0.307s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] <== create_volume: return (1406ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356cfc15-44eb-47ed-9668-22ea469f93cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f27b4663-9908-4360-a4e4-68a8643f9488', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d850ed-431d-4785-93e7-25c022feecf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:36:41 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Volume volume-f27b4663-9908-4360-a4e4-68a8643f9488 (f27b4663-9908-4360-a4e4-68a8643f9488): created successfully
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d850ed-431d-4785-93e7-25c022feecf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Flow 'volume_create_manager' (85fad14b-624c-4cd2-81fe-d1dfcf084f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Created reservations ['d129cd5c-2849-4273-af73-fd2c5d380873', '39c16480-c5d8-4e98-b791-8f715a020f2d', '093eabc7-3718-4b96-93ca-e2d61d78698f', '79460b53-e577-4dde-be38-d55e946a3966'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:36:41 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9dc07de1-d3b6-40e9-8e22-e0b6d721053d tempest-AttachVolumeNegativeTest-182207659 None] Created volume successfully.
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.167s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:42 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:36:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Deleted volume successfully.
Sep 18 13:36:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ec106950-bdb8-4e14-8d4e-0ab155020ee4 tempest-VolumesMetadataTest-1985940859 None] Lock "cinder-e473699d-d06b-4ced-89ab-d9e0c1d3c48c-delete_volume" released by "delete_volume" :: held 5.121s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:36:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-e68f4b65-c0a2-42c6-8a52-6627c5ff224c req-f32cecd8-2500-4fbc-bd3f-2650ac248a53 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:36:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-e68f4b65-c0a2-42c6-8a52-6627c5ff224c req-f32cecd8-2500-4fbc-bd3f-2650ac248a53 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:36:47 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f215af-ad54-4a2f-a7c1-66672b678b20]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:36:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-e68f4b65-c0a2-42c6-8a52-6627c5ff224c req-f32cecd8-2500-4fbc-bd3f-2650ac248a53 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:36:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-e68f4b65-c0a2-42c6-8a52-6627c5ff224c req-f32cecd8-2500-4fbc-bd3f-2650ac248a53 tempest-AttachVolumeNegativeTest-182207659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488" returned: 0 in 0.532s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:36:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-e68f4b65-c0a2-42c6-8a52-6627c5ff224c req-f32cecd8-2500-4fbc-bd3f-2650ac248a53 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.591s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:36:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-e68f4b65-c0a2-42c6-8a52-6627c5ff224c req-f32cecd8-2500-4fbc-bd3f-2650ac248a53 tempest-AttachVolumeNegativeTest-182207659 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-f27b4663-9908-4360-a4e4-68a8643f9488', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5177a5c-e2e6-4688-aaca-bfe872277524', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:36:48 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-e68f4b65-c0a2-42c6-8a52-6627c5ff224c req-f32cecd8-2500-4fbc-bd3f-2650ac248a53 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:36:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-e68f4b65-c0a2-42c6-8a52-6627c5ff224c req-f32cecd8-2500-4fbc-bd3f-2650ac248a53 tempest-AttachVolumeNegativeTest-182207659 None] attachment_update completed successfully.
Sep 18 13:36:58 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=16,cinder:SELECT=15,cinder:DELETE=3,cinder:INSERT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:36:58 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=13,cinder:UPDATE=19,cinder:INSERT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:37:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Flow 'volume_create_manager' (9894a919-1749-44cd-b2a1-e7d7444b3421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1447af4-ce14-4bc4-88e1-e556df3e229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1447af4-ce14-4bc4-88e1-e556df3e229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-756288581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a51fbb-8f19-4d61-9b3e-f97968615255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af9ada5d194b0cb87e072370bc30cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:37:00Z,use_quota=True,user_id='9ea0c847902f4bde84d63fc8c4076b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cca587-8b5d-4618-80fa-4a38a0c7e659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cca587-8b5d-4618-80fa-4a38a0c7e659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfda4b8-9d42-4ba6-b71a-704de81bc8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfda4b8-9d42-4ba6-b71a-704de81bc8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a51fbb-8f19-4d61-9b3e-f97968615255', 'volume_name': 'volume-c2a51fbb-8f19-4d61-9b3e-f97968615255', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51b73eb-c651-4e5a-a2fa-35f79f9c5b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51b73eb-c651-4e5a-a2fa-35f79f9c5b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5acc82-a599-4dca-afa0-8ea692e736a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:37:00 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Volume c2a51fbb-8f19-4d61-9b3e-f97968615255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a51fbb-8f19-4d61-9b3e-f97968615255', 'volume_size': 1}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-756288581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a51fbb-8f19-4d61-9b3e-f97968615255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80af9ada5d194b0cb87e072370bc30cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:37:00Z,use_quota=True,user_id='9ea0c847902f4bde84d63fc8c4076b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Creating volume c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:37:00 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:37:00 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=52, name=volume-c2a51fbb-8f19-4d61-9b3e-f97968615255, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 1073741824" returned: 0 in 0.351s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255" returned: 0 in 0.095s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] <== create_volume: return (539ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:37:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.550s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:37:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5acc82-a599-4dca-afa0-8ea692e736a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a51fbb-8f19-4d61-9b3e-f97968615255', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:37:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d1cbb1-6b7b-4598-b8ac-0a0f4afd57b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:37:01 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Volume volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 (c2a51fbb-8f19-4d61-9b3e-f97968615255): created successfully
Sep 18 13:37:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d1cbb1-6b7b-4598-b8ac-0a0f4afd57b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:37:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Flow 'volume_create_manager' (9894a919-1749-44cd-b2a1-e7d7444b3421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:37:01 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-a96d63ca-c4d1-428b-8b6e-b6fb84c0d337 tempest-VolumesActionsTest-1285879216 None] Created volume successfully.
Sep 18 13:37:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-aba8827d-1060-48b1-bc21-62f5faab16ce req-85c54802-a4c9-4a96-9bcb-2947d182de47 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:37:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-aba8827d-1060-48b1-bc21-62f5faab16ce req-85c54802-a4c9-4a96-9bcb-2947d182de47 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:37:02 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-aba8827d-1060-48b1-bc21-62f5faab16ce req-85c54802-a4c9-4a96-9bcb-2947d182de47 tempest-AttachVolumeShelveTestJSON-1618960657 None] Terminate volume connection completed successfully.
Sep 18 13:37:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-aba8827d-1060-48b1-bc21-62f5faab16ce req-85c54802-a4c9-4a96-9bcb-2947d182de47 tempest-AttachVolumeShelveTestJSON-1618960657 None] Deleting attachment ad151c61-5520-4f44-a51d-9357abd89f0a. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:37:11 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.292s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:37:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:37:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-717f0a32-e343-4146-acd5-12f7b0c5338d req-23fffd6a-2bd1-4370-b3c3-a419f804d6a4 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:37:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-717f0a32-e343-4146-acd5-12f7b0c5338d req-23fffd6a-2bd1-4370-b3c3-a419f804d6a4 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:37:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-717f0a32-e343-4146-acd5-12f7b0c5338d req-23fffd6a-2bd1-4370-b3c3-a419f804d6a4 tempest-AttachVolumeNegativeTest-182207659 None] Terminate volume connection completed successfully.
Sep 18 13:37:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-717f0a32-e343-4146-acd5-12f7b0c5338d req-23fffd6a-2bd1-4370-b3c3-a419f804d6a4 tempest-AttachVolumeNegativeTest-182207659 None] Deleting attachment f5177a5c-e2e6-4688-aaca-bfe872277524. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:37:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:37:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:37:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d0e45b6c-a2ff-41a9-b9f4-d76d12a25681 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255" by "attach_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:37:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d0e45b6c-a2ff-41a9-b9f4-d76d12a25681 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255" acquired by "attach_volume" :: waited 0.066s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:37:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-d0e45b6c-a2ff-41a9-b9f4-d76d12a25681 tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:37:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-d0e45b6c-a2ff-41a9-b9f4-d76d12a25681 tempest-VolumesActionsTest-1285879216 None] Attaching volume c2a51fbb-8f19-4d61-9b3e-f97968615255 to instance 820104b3-344e-4922-a595-b4c6d600bd5f at mountpoint /dev/vdb on host None.
Sep 18 13:37:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-d0e45b6c-a2ff-41a9-b9f4-d76d12a25681 tempest-VolumesActionsTest-1285879216 None] Attach volume completed successfully.
Sep 18 13:37:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d0e45b6c-a2ff-41a9-b9f4-d76d12a25681 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255" released by "attach_volume" :: held 0.435s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:37:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-a38448d3-a482-436e-a1ee-0c73818068d3 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255-detach_volume" by "detach_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:37:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-a38448d3-a482-436e-a1ee-0c73818068d3 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:37:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-a38448d3-a482-436e-a1ee-0c73818068d3 tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:37:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-a38448d3-a482-436e-a1ee-0c73818068d3 tempest-VolumesActionsTest-1285879216 None] Detaching volume c2a51fbb-8f19-4d61-9b3e-f97968615255 from instance 820104b3-344e-4922-a595-b4c6d600bd5f.
Sep 18 13:37:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-a38448d3-a482-436e-a1ee-0c73818068d3 tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:37:35 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-a38448d3-a482-436e-a1ee-0c73818068d3 tempest-VolumesActionsTest-1285879216 None] Detach volume completed successfully.
Sep 18 13:37:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-a38448d3-a482-436e-a1ee-0c73818068d3 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255-detach_volume" released by "detach_volume" :: held 0.190s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:37:45 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=2,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:37:45 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=11,cinder:INSERT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:38:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:38:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:38:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:38:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:38:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:38:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.076s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:38:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:38:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.215s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:38:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:38:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-75aee006-1b2e-4ce9-88a0-70306b11c6f7 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255" by "attach_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:38:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-75aee006-1b2e-4ce9-88a0-70306b11c6f7 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255" acquired by "attach_volume" :: waited 0.078s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:38:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-75aee006-1b2e-4ce9-88a0-70306b11c6f7 tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:38:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-75aee006-1b2e-4ce9-88a0-70306b11c6f7 tempest-VolumesActionsTest-1285879216 None] Attaching volume c2a51fbb-8f19-4d61-9b3e-f97968615255 to instance 392c53fe-f40e-4df8-af21-4f3dc239849e at mountpoint /dev/vdb on host None.
Sep 18 13:38:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-75aee006-1b2e-4ce9-88a0-70306b11c6f7 tempest-VolumesActionsTest-1285879216 None] Attach volume completed successfully.
Sep 18 13:38:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-75aee006-1b2e-4ce9-88a0-70306b11c6f7 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255" released by "attach_volume" :: held 0.629s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:38:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-099f68c1-5ff1-476a-90aa-13de7ae3ad74 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255-detach_volume" by "detach_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:38:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-099f68c1-5ff1-476a-90aa-13de7ae3ad74 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:38:35 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-099f68c1-5ff1-476a-90aa-13de7ae3ad74 tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:38:35 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-099f68c1-5ff1-476a-90aa-13de7ae3ad74 tempest-VolumesActionsTest-1285879216 None] Detaching volume c2a51fbb-8f19-4d61-9b3e-f97968615255 from instance 392c53fe-f40e-4df8-af21-4f3dc239849e.
Sep 18 13:38:35 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-099f68c1-5ff1-476a-90aa-13de7ae3ad74 tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:38:35 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-099f68c1-5ff1-476a-90aa-13de7ae3ad74 tempest-VolumesActionsTest-1285879216 None] Detach volume completed successfully.
Sep 18 13:38:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-099f68c1-5ff1-476a-90aa-13de7ae3ad74 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:38:45 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:38:45 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:38:53 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:38:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:38:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:38:53 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc29820-e3ce-462b-bb96-6ba378608c9b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:38:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:38:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255" returned: 0 in 0.510s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:38:54 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd34c769-0c14-4b42-bd86-a198a967b06f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:38:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:38:54 devstack quobyte-client[82822]: System call of process 91756 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:38:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255" returned: 0 in 0.475s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:38:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.26783a06-dd53-4610-befd-6a7ba5de6c2fe1l1zmpn.img {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:03 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:39:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.26783a06-dd53-4610-befd-6a7ba5de6c2fe1l1zmpn.img" returned: 0 in 9.379s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:39:04 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4810dcc-8e48-461f-bce4-726f31499165]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:39:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255" returned: 0 in 0.676s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:39:04 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Image conversion details: src /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255, size 1024.00 MB, duration 9.39 sec, destination /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.26783a06-dd53-4610-befd-6a7ba5de6c2fe1l1zmpn.img {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:39:04 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Converted 1024.00 MB image at 109.08 MB/s
Sep 18 13:39:05 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] 26783a06-dd53-4610-befd-6a7ba5de6c2f was raw, no need to convert to raw {{(pid=82799) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 18 13:39:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:39:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:39:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:39:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:39:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:39:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:39:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.222s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:39:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:39:15 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:39:24 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Flow 'volume_create_manager' (75e07aa4-31ec-4d4c-9a98-2727a28b30e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646c616e-173b-458b-ba42-e20e7d7fb0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646c616e-173b-458b-ba42-e20e7d7fb0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1427180253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d15d716-b132-48e1-9987-9d976a30db88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38ccc70448b4872a557103f4c2a7aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:39:24Z,use_quota=True,user_id='560f7e0e5bde4b8689814d25f5dd119e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aee501-c5c2-431f-95d0-e30ab899619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aee501-c5c2-431f-95d0-e30ab899619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c820ab-9b52-4fc7-b4df-ed8d392c32a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c820ab-9b52-4fc7-b4df-ed8d392c32a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d15d716-b132-48e1-9987-9d976a30db88', 'volume_name': 'volume-8d15d716-b132-48e1-9987-9d976a30db88', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213dd621-da87-425f-9031-264adac0d85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213dd621-da87-425f-9031-264adac0d85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057f56d8-e9d5-4fed-9cfe-cef590fc81b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:24 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume 8d15d716-b132-48e1-9987-9d976a30db88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d15d716-b132-48e1-9987-9d976a30db88', 'volume_size': 1}
Sep 18 13:39:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:39:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:39:34 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:39:50 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Flow 'volume_create_manager' (7fb15163-7e09-4d7e-b2bf-30b10fdec983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42706278-a574-418e-900d-80771b182e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42706278-a574-418e-900d-80771b182e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1318502035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf259dc-c408-4915-80da-f7ff13bed6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc136a134457439f9a11aad3687874f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:39:50Z,use_quota=True,user_id='646839e62e6042bea92e1762f9f54028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13a10b8-86c8-4474-bfb5-cd7e907f8053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13a10b8-86c8-4474-bfb5-cd7e907f8053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baec9963-9f22-4cba-8c32-8e96ae11d14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baec9963-9f22-4cba-8c32-8e96ae11d14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf259dc-c408-4915-80da-f7ff13bed6a2', 'volume_name': 'volume-acf259dc-c408-4915-80da-f7ff13bed6a2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1f01e0-f5be-4b38-9a35-c1f5e94cec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1f01e0-f5be-4b38-9a35-c1f5e94cec43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98a2c2d-b063-41f2-968f-8d719175e4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:50 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Volume acf259dc-c408-4915-80da-f7ff13bed6a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf259dc-c408-4915-80da-f7ff13bed6a2', 'volume_size': 1}
Sep 18 13:39:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 62.219s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Uploaded volume to glance image-id: 26783a06-dd53-4610-befd-6a7ba5de6c2f. {{(pid=82799) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.155s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1427180253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d15d716-b132-48e1-9987-9d976a30db88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38ccc70448b4872a557103f4c2a7aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:39:24Z,use_quota=True,user_id='560f7e0e5bde4b8689814d25f5dd119e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Creating volume 8d15d716-b132-48e1-9987-9d976a30db88 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:39:55 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:39:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8d15d716-b132-48e1-9987-9d976a30db88 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:55 devstack quobyte-client[82822]: System call of process 91946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:39:55 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=53, name=volume-8d15d716-b132-48e1-9987-9d976a30db88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:39:56 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ac8c7a96-780f-4c77-ac6e-24e4b06ec9f9 tempest-VolumesActionsTest-1285879216 None] Copy volume to image completed successfully.
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8d15d716-b132-48e1-9987-9d976a30db88 1073741824" returned: 0 in 0.412s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8d15d716-b132-48e1-9987-9d976a30db88 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8d15d716-b132-48e1-9987-9d976a30db88" returned: 0 in 0.131s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] <== create_volume: return (606ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.622s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.468s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1318502035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf259dc-c408-4915-80da-f7ff13bed6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc136a134457439f9a11aad3687874f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:39:50Z,use_quota=True,user_id='646839e62e6042bea92e1762f9f54028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Creating volume acf259dc-c408-4915-80da-f7ff13bed6a2 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:39:56 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:56 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=54, name=volume-acf259dc-c408-4915-80da-f7ff13bed6a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057f56d8-e9d5-4fed-9cfe-cef590fc81b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d15d716-b132-48e1-9987-9d976a30db88', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488cc9ed-3f10-4d54-8ef1-f7e599557109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:57 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume volume-8d15d716-b132-48e1-9987-9d976a30db88 (8d15d716-b132-48e1-9987-9d976a30db88): created successfully
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488cc9ed-3f10-4d54-8ef1-f7e599557109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Flow 'volume_create_manager' (75e07aa4-31ec-4d4c-9a98-2727a28b30e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2 1073741824" returned: 0 in 0.459s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:57 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-cad60b11-6205-49af-b6da-1f81c48b2a41 tempest-AttachVolumeShelveTestJSON-1618960657 None] Created volume successfully.
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2" returned: 0 in 0.234s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] <== create_volume: return (725ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98a2c2d-b063-41f2-968f-8d719175e4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf259dc-c408-4915-80da-f7ff13bed6a2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55893e4a-bec4-4a54-a50f-bb98b1f4d985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:39:57 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Volume volume-acf259dc-c408-4915-80da-f7ff13bed6a2 (acf259dc-c408-4915-80da-f7ff13bed6a2): created successfully
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55893e4a-bec4-4a54-a50f-bb98b1f4d985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Flow 'volume_create_manager' (7fb15163-7e09-4d7e-b2bf-30b10fdec983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:39:57 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-69254b68-603f-417a-9ba8-f6e3556b9e28 tempest-AttachVolumeNegativeTest-182207659 None] Created volume successfully.
Sep 18 13:39:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f4fe01-3fe8-48d0-bd2f-80637015a417]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:39:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255" returned: 0 in 0.555s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:39:58 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba5830-c100-4889-8837-dfaf9bdd8eef]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:39:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:59 devstack quobyte-client[82822]: System call of process 91961 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:39:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255" returned: 0 in 0.584s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:39:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:39:59 devstack quobyte-client[82822]: System call of process 91971 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:40:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img" returned: 0 in 8.088s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:07 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ac7c5-dfb3-481b-b8a2-fda8ecffb6e8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:40:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:07 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:40:07 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:40:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-285b1c1f-3dd5-4e97-bc1e-f33fdda6196f req-b2f00f0a-2b20-4ca2-a203-39f92a4a01b1 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:40:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255" returned: 0 in 0.963s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:08 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Image conversion details: src /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255, size 1024.00 MB, duration 8.12 sec, destination /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:40:08 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Converted 1024.00 MB image at 126.14 MB/s
Sep 18 13:40:08 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] 962eda42-1f64-4708-9dfd-d33492ef9d61 was raw, converting to qcow2 {{(pid=82799) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 18 13:40:08 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c248d02-76ca-4a82-9010-c3ca4db4f44b]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:40:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img" returned: 0 in 0.399s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img" returned: 1 in 0.392s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:40:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img /opt/stack/data/cinder/conversion/vol_upload_1bamhqm5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img /opt/stack/data/cinder/conversion/vol_upload_1bamhqm5" returned: 0 in 0.223s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:09 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Image conversion details: src /opt/stack/data/cinder/conversion/c2a51fbb-8f19-4d61-9b3e-f97968615255.temp_image.962eda42-1f64-4708-9dfd-d33492ef9d61xocgx60z.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1bamhqm5 {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:40:09 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 18 13:40:09 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[26329497-84c6-4373-8bb2-434022dc6f7a]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:40:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1bamhqm5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1bamhqm5" returned: 0 in 0.504s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.937s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:40:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Uploaded volume to glance image-id: 962eda42-1f64-4708-9dfd-d33492ef9d61. {{(pid=82799) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 18 13:40:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-285b1c1f-3dd5-4e97-bc1e-f33fdda6196f req-b2f00f0a-2b20-4ca2-a203-39f92a4a01b1 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.956s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ee7477-dd06-4f1e-b1dd-82a9f00c2bc8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-285b1c1f-3dd5-4e97-bc1e-f33fdda6196f req-b2f00f0a-2b20-4ca2-a203-39f92a4a01b1 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:12 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-a2b34666-d979-48f9-a791-82a0085c7d7e tempest-VolumesActionsTest-1285879216 None] Copy volume to image completed successfully.
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-285b1c1f-3dd5-4e97-bc1e-f33fdda6196f req-b2f00f0a-2b20-4ca2-a203-39f92a4a01b1 tempest-AttachVolumeNegativeTest-182207659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2" returned: 0 in 0.796s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-285b1c1f-3dd5-4e97-bc1e-f33fdda6196f req-b2f00f0a-2b20-4ca2-a203-39f92a4a01b1 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.968s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:40:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.391s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:40:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-285b1c1f-3dd5-4e97-bc1e-f33fdda6196f req-b2f00f0a-2b20-4ca2-a203-39f92a4a01b1 tempest-AttachVolumeNegativeTest-182207659 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-acf259dc-c408-4915-80da-f7ff13bed6a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1acbd34d-bec3-499a-a082-695a1fc2a4d9', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:40:13 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-285b1c1f-3dd5-4e97-bc1e-f33fdda6196f req-b2f00f0a-2b20-4ca2-a203-39f92a4a01b1 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:40:13 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-285b1c1f-3dd5-4e97-bc1e-f33fdda6196f req-b2f00f0a-2b20-4ca2-a203-39f92a4a01b1 tempest-AttachVolumeNegativeTest-182207659 None] attachment_update completed successfully.
Sep 18 13:40:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:40:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:40:14 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:40:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "cinder-quobyte-c2a51fbb-8f19-4d61-9b3e-f97968615255" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:40:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-quobyte-c2a51fbb-8f19-4d61-9b3e-f97968615255" acquired by "delete_volume" :: waited 0.049s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:40:14 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8dfea2-69f7-451d-a661-8bc32ca25924]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:40:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255" returned: 0 in 0.597s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2a51fbb-8f19-4d61-9b3e-f97968615255" returned: 0 in 0.098s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-quobyte-c2a51fbb-8f19-4d61-9b3e-f97968615255" released by "delete_volume" :: held 0.929s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Created reservations ['54ac7a8e-a8b2-49a2-ac47-23385f416295', 'e99ec3c1-b2bc-40f2-8cc4-776f78849052', '5405d753-a18d-4671-8933-a2300071cc6a', '1dc72d73-83e7-468d-a7c6-1944cd0f22df'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:40:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:40:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.117s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:40:16 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:40:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Deleted volume successfully.
Sep 18 13:40:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1a430e6e-21a2-4893-b9cb-6a8fb73f7b60 tempest-VolumesActionsTest-1285879216 None] Lock "cinder-c2a51fbb-8f19-4d61-9b3e-f97968615255-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:40:24 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-8fec23e3-8c3f-4bd1-9a0e-7238a657dd66 req-d96d5dbf-1eb8-456a-9fcb-259e63110ef9 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:40:24 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-8fec23e3-8c3f-4bd1-9a0e-7238a657dd66 req-d96d5dbf-1eb8-456a-9fcb-259e63110ef9 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:40:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-8fec23e3-8c3f-4bd1-9a0e-7238a657dd66 req-d96d5dbf-1eb8-456a-9fcb-259e63110ef9 tempest-AttachVolumeShelveTestJSON-1618960657 None] No connector for attachment 47852b17-3b83-4866-bb03-5c191bbfe286; skipping storage backend terminate_connection call. {{(pid=82799) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 18 13:40:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-8fec23e3-8c3f-4bd1-9a0e-7238a657dd66 req-d96d5dbf-1eb8-456a-9fcb-259e63110ef9 tempest-AttachVolumeShelveTestJSON-1618960657 None] Deleting attachment 47852b17-3b83-4866-bb03-5c191bbfe286. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:40:34 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=10,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:40:34 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:40:43 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-8b4c1781-c9c4-42de-b8c5-e71f87eb19df req-649dfc80-8f90-410c-b9c5-2c0c68bc2356 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:40:43 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-8b4c1781-c9c4-42de-b8c5-e71f87eb19df req-649dfc80-8f90-410c-b9c5-2c0c68bc2356 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:40:43 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-8b4c1781-c9c4-42de-b8c5-e71f87eb19df req-649dfc80-8f90-410c-b9c5-2c0c68bc2356 tempest-AttachVolumeNegativeTest-182207659 None] Terminate volume connection completed successfully.
Sep 18 13:40:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-8b4c1781-c9c4-42de-b8c5-e71f87eb19df req-649dfc80-8f90-410c-b9c5-2c0c68bc2356 tempest-AttachVolumeNegativeTest-182207659 None] Deleting attachment 1acbd34d-bec3-499a-a082-695a1fc2a4d9. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:40:53 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:41:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "cinder-acf259dc-c408-4915-80da-f7ff13bed6a2-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:41:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-acf259dc-c408-4915-80da-f7ff13bed6a2-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:41:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:41:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "cinder-quobyte-acf259dc-c408-4915-80da-f7ff13bed6a2" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:41:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-quobyte-acf259dc-c408-4915-80da-f7ff13bed6a2" acquired by "delete_volume" :: waited 0.023s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:41:05 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e29477-f996-4a6c-a207-c47d9c030228]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:41:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2" returned: 0 in 0.866s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acf259dc-c408-4915-80da-f7ff13bed6a2" returned: 0 in 0.234s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-quobyte-acf259dc-c408-4915-80da-f7ff13bed6a2" released by "delete_volume" :: held 1.654s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:41:07 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Created reservations ['61eebe4f-db99-4740-80f4-0e0035eee2f5', '273d9a13-1492-4f19-8277-76f5ee81b168', 'f4228bf3-56d7-426d-9aa5-7fa668477c74', 'ec0185cc-01c2-426b-a7c9-3b45ca70e7fa'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:41:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:41:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:41:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.196s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:08 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:41:08 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Deleted volume successfully.
Sep 18 13:41:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "cinder-f27b4663-9908-4360-a4e4-68a8643f9488-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:41:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d25d78e1-d0bd-49e0-a56d-71d06aa8d118 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-acf259dc-c408-4915-80da-f7ff13bed6a2-delete_volume" released by "delete_volume" :: held 3.681s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:41:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-f27b4663-9908-4360-a4e4-68a8643f9488-delete_volume" acquired by "delete_volume" :: waited 0.210s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:41:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:41:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "cinder-quobyte-f27b4663-9908-4360-a4e4-68a8643f9488" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:41:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-quobyte-f27b4663-9908-4360-a4e4-68a8643f9488" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:41:09 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[875755f3-8476-4d74-9a4c-2190a5aba784]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:41:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488" returned: 0 in 0.472s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f27b4663-9908-4360-a4e4-68a8643f9488" returned: 0 in 0.104s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-quobyte-f27b4663-9908-4360-a4e4-68a8643f9488" released by "delete_volume" :: held 0.791s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:41:10 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Created reservations ['15cc52d5-0307-40b2-82a7-4e628d832c61', 'c8994d7b-bbbf-4a9d-b371-c3944272aee9', 'df0646e3-1b47-4f2c-9f26-521d8f7cd5a7', 'b1860d52-6f25-4c34-8ff2-40508f89d1a0'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:41:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:41:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:41:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.119s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:10 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:41:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Deleted volume successfully.
Sep 18 13:41:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3efcc8f5-d480-4454-aa51-9011f887e073 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-f27b4663-9908-4360-a4e4-68a8643f9488-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:41:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "cinder-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:41:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:41:11 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:41:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "cinder-quobyte-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:41:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-quobyte-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af" acquired by "delete_volume" :: waited 0.031s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:41:11 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bef65e-b5ca-4068-bf55-9bcc701fa4bc]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:41:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:41:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:41:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:41:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af" returned: 0 in 1.345s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.397s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:41:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af" returned: 0 in 0.271s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-quobyte-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af" released by "delete_volume" :: held 1.811s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:41:13 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Created reservations ['73c5864c-946d-43f2-9424-6ef41a1e195e', 'b8ad6eb5-b3a9-49a7-90be-edbf8fe09195', '7919c14f-b06e-41a0-98db-8b6a7b0a6fb5', 'b8d52d02-c5bb-4b03-a4e9-c9b266dcb70e'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:41:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:41:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:41:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.113s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:14 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:41:14 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Deleted volume successfully.
Sep 18 13:41:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6c7c754-843c-4a86-acd8-85cb96e5d168 tempest-AttachVolumeNegativeTest-182207659 None] Lock "cinder-cee3b22e-e548-4fc6-8b42-dc6ff0aaa5af-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:41:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=12,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:41:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:41:31 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:41:31 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Flow 'volume_create_manager' (edd1b6d3-26bf-4708-b714-62ce07634dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56d87c4-765f-411c-9337-534678774da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56d87c4-765f-411c-9337-534678774da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2139127222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bf98fb-81b7-49c4-bb4a-a5e692e304c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73f958957c0e47ab8d63f26eb63f4730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:41:32Z,use_quota=True,user_id='4a60f287b1fc4939b03db70fd48276d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7346bde8-17dc-4aa9-90fc-f8fc4b570048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7346bde8-17dc-4aa9-90fc-f8fc4b570048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7b42e-d6ff-4d27-b677-1d101ad97f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7b42e-d6ff-4d27-b677-1d101ad97f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56bf98fb-81b7-49c4-bb4a-a5e692e304c2', 'volume_name': 'volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed774897-077e-45f5-95e0-8511c58117fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed774897-077e-45f5-95e0-8511c58117fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a767566-58d5-497d-ae1c-30e6ae853f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:32 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Volume 56bf98fb-81b7-49c4-bb4a-a5e692e304c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2', 'volume_size': 1}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2139127222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bf98fb-81b7-49c4-bb4a-a5e692e304c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73f958957c0e47ab8d63f26eb63f4730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:41:32Z,use_quota=True,user_id='4a60f287b1fc4939b03db70fd48276d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Creating volume 56bf98fb-81b7-49c4-bb4a-a5e692e304c2 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:41:32 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:41:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:32 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=55, name=volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:41:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2 1073741824" returned: 0 in 1.055s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2" returned: 0 in 0.475s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] <== create_volume: return (1733ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:41:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a767566-58d5-497d-ae1c-30e6ae853f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cbf72a-1699-497b-8920-3c8a3ccf5e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:34 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Volume volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2 (56bf98fb-81b7-49c4-bb4a-a5e692e304c2): created successfully
Sep 18 13:41:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cbf72a-1699-497b-8920-3c8a3ccf5e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Flow 'volume_create_manager' (edd1b6d3-26bf-4708-b714-62ce07634dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:41:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-c6639356-9ade-4123-8dd4-6dfa6bc8a3e2 req-bcda1ca4-e80e-4d78-ad67-909a61c2cdef tempest-VolumesGetTestJSON-481325533 None] Created volume successfully.
Sep 18 13:41:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Acquiring lock "cinder-56bf98fb-81b7-49c4-bb4a-a5e692e304c2-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:41:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Lock "cinder-56bf98fb-81b7-49c4-bb4a-a5e692e304c2-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:41:36 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:41:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Acquiring lock "cinder-quobyte-56bf98fb-81b7-49c4-bb4a-a5e692e304c2" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:41:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Lock "cinder-quobyte-56bf98fb-81b7-49c4-bb4a-a5e692e304c2" acquired by "delete_volume" :: waited 0.036s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:41:36 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2ccc8d-15ed-49a9-af98-d88226bf2b0e]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:41:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2" returned: 0 in 0.871s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-56bf98fb-81b7-49c4-bb4a-a5e692e304c2" returned: 0 in 0.238s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Lock "cinder-quobyte-56bf98fb-81b7-49c4-bb4a-a5e692e304c2" released by "delete_volume" :: held 1.615s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:41:38 devstack cinder-volume[82799]: DEBUG cinder.quota [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Created reservations ['a6135eee-f941-4356-b197-00cbce554d79', '219bf07a-4e1d-4d07-93d8-682723640760', 'b92573be-d22b-4862-b224-d6691ab0e87e', '87eeb3d8-a7b8-4ac2-9823-09c4e0bf7d57'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:41:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:41:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:41:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.222s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:39 devstack cinder-volume[82799]: DEBUG cinder.manager [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:41:39 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Deleted volume successfully.
Sep 18 13:41:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-b7d1a46a-92da-4504-8b61-911f615b6d4f req-c50fcd40-7802-446a-964a-88cd3ab1bcf4 tempest-VolumesGetTestJSON-481325533 None] Lock "cinder-56bf98fb-81b7-49c4-bb4a-a5e692e304c2-delete_volume" released by "delete_volume" :: held 3.907s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:41:48 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=14,cinder:SELECT=5 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:41:49 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=4 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:41:53 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-00c8fd1b-7309-425c-8c2e-e463d94e3236 tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:41:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-00c8fd1b-7309-425c-8c2e-e463d94e3236 tempest-GroupsTest-1028365635 None] Group tempest-Group1-1639876089: creating
Sep 18 13:41:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-00c8fd1b-7309-425c-8c2e-e463d94e3236 tempest-GroupsTest-1028365635 None] Group tempest-Group1-1639876089: created successfully
Sep 18 13:41:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-00c8fd1b-7309-425c-8c2e-e463d94e3236 tempest-GroupsTest-1028365635 None] Create group completed successfully.
Sep 18 13:41:55 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-830b7bac-c27a-48bf-89ff-d8460758748e tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:41:55 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-830b7bac-c27a-48bf-89ff-d8460758748e tempest-GroupsTest-1028365635 None] Group tempest-Group2-1515720452: creating
Sep 18 13:41:55 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-830b7bac-c27a-48bf-89ff-d8460758748e tempest-GroupsTest-1028365635 None] Group tempest-Group2-1515720452: created successfully
Sep 18 13:41:55 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-830b7bac-c27a-48bf-89ff-d8460758748e tempest-GroupsTest-1028365635 None] Create group completed successfully.
Sep 18 13:41:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Flow 'volume_create_manager' (fce9fdc6-0975-456f-9d35-495ebccc6238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a51d0a-0804-4b90-ba4f-a95866a08d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a51d0a-0804-4b90-ba4f-a95866a08d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1909084043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=96ca25fd-cb49-4a7c-a502-7553f75cce4c,host='devstack@QuobyteHD#QuobyteHD',id=9efc7509-9805-4511-b0cc-e9c67b676321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce72c15436ba4787858562d4b4f9d85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:41:57Z,use_quota=True,user_id='e86b7bb8e8374fc4b6809fc34d0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f6372bc-85d7-4abe-854f-9bd60c91cf0a),volume_type_id=0f6372bc-85d7-4abe-854f-9bd60c91cf0a)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825ab69e-793e-4c18-a96b-d637864792ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825ab69e-793e-4c18-a96b-d637864792ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d14e25-aaf9-46ec-ab4f-c0ce73d5de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d14e25-aaf9-46ec-ab4f-c0ce73d5de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9efc7509-9805-4511-b0cc-e9c67b676321', 'volume_name': 'volume-9efc7509-9805-4511-b0cc-e9c67b676321', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8a33c5-b6e5-4cd5-b5b1-70ce6593b434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8a33c5-b6e5-4cd5-b5b1-70ce6593b434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c0c23d-10c2-4f6d-a840-ebae4e0f13e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:57 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Volume 9efc7509-9805-4511-b0cc-e9c67b676321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9efc7509-9805-4511-b0cc-e9c67b676321', 'volume_size': 1}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=96ca25fd-cb49-4a7c-a502-7553f75cce4c,created_at=2025-09-18T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1909084043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=96ca25fd-cb49-4a7c-a502-7553f75cce4c,host='devstack@QuobyteHD#QuobyteHD',id=9efc7509-9805-4511-b0cc-e9c67b676321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce72c15436ba4787858562d4b4f9d85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:41:57Z,use_quota=True,user_id='e86b7bb8e8374fc4b6809fc34d0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f6372bc-85d7-4abe-854f-9bd60c91cf0a),volume_type_id=0f6372bc-85d7-4abe-854f-9bd60c91cf0a)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Creating volume 9efc7509-9805-4511-b0cc-e9c67b676321 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:41:57 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-9efc7509-9805-4511-b0cc-e9c67b676321 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:57 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=56, name=volume-9efc7509-9805-4511-b0cc-e9c67b676321, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:41:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:41:57 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Flow 'volume_create_manager' (ed59c359-b20c-42f9-a068-36f09b70cb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fcb2652-b8af-4828-a7f1-03d852f6780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fcb2652-b8af-4828-a7f1-03d852f6780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1408610055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11af8750-2729-486f-8d1c-7ecf8399ad6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfca87caf6f54523b617f3ea8b16627e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:41:57Z,use_quota=True,user_id='7b306428ab08448697a6f7b8736cfcf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0ebc95-6c22-4cdd-b097-9fad203e7618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0ebc95-6c22-4cdd-b097-9fad203e7618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24750c80-9819-40d1-90d7-5ab6eabb2dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24750c80-9819-40d1-90d7-5ab6eabb2dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11af8750-2729-486f-8d1c-7ecf8399ad6d', 'volume_name': 'volume-11af8750-2729-486f-8d1c-7ecf8399ad6d', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4953ab08-f50a-433d-b571-36876cf98a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4953ab08-f50a-433d-b571-36876cf98a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34d5415-2440-4bcf-98af-a532f2418b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:58 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Volume 11af8750-2729-486f-8d1c-7ecf8399ad6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11af8750-2729-486f-8d1c-7ecf8399ad6d', 'volume_size': 1}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-9efc7509-9805-4511-b0cc-e9c67b676321 1073741824" returned: 0 in 0.813s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-9efc7509-9805-4511-b0cc-e9c67b676321 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-9efc7509-9805-4511-b0cc-e9c67b676321" returned: 0 in 0.169s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] <== create_volume: return (1019ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.317s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1408610055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11af8750-2729-486f-8d1c-7ecf8399ad6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfca87caf6f54523b617f3ea8b16627e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:41:57Z,use_quota=True,user_id='7b306428ab08448697a6f7b8736cfcf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Creating volume 11af8750-2729-486f-8d1c-7ecf8399ad6d {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:41:58 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:58 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=57, name=volume-11af8750-2729-486f-8d1c-7ecf8399ad6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:41:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c0c23d-10c2-4f6d-a840-ebae4e0f13e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9efc7509-9805-4511-b0cc-e9c67b676321', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd90d09-9f70-4efa-9c71-245057621914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:41:59 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Volume volume-9efc7509-9805-4511-b0cc-e9c67b676321 (9efc7509-9805-4511-b0cc-e9c67b676321): created successfully
Sep 18 13:41:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd90d09-9f70-4efa-9c71-245057621914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:41:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Flow 'volume_create_manager' (fce9fdc6-0975-456f-9d35-495ebccc6238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:41:59 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-76eaf024-9389-4d55-ac2f-8e06f05c4df8 tempest-GroupsTest-1028365635 None] Created volume successfully.
Sep 18 13:41:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d 1073741824" returned: 0 in 0.688s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:41:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d" returned: 0 in 0.383s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:41:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] <== create_volume: return (1149ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:41:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34d5415-2440-4bcf-98af-a532f2418b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11af8750-2729-486f-8d1c-7ecf8399ad6d', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81079d7-0b6b-408d-97fe-95ff39a0f92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:00 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Volume volume-11af8750-2729-486f-8d1c-7ecf8399ad6d (11af8750-2729-486f-8d1c-7ecf8399ad6d): created successfully
Sep 18 13:42:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81079d7-0b6b-408d-97fe-95ff39a0f92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Flow 'volume_create_manager' (ed59c359-b20c-42f9-a068-36f09b70cb27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:42:00 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1686449e-0db3-46e3-9d63-30e67f9687bf tempest-TestMinimumBasicScenario-1462490838 None] Created volume successfully.
Sep 18 13:42:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Acquiring lock "cinder-quobyte-9efc7509-9805-4511-b0cc-e9c67b676321" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:42:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Lock "cinder-quobyte-9efc7509-9805-4511-b0cc-e9c67b676321" acquired by "delete_volume" :: waited 0.107s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:42:00 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0178e9-24b8-4486-98b1-c3bd9c9f2b92]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:42:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-9efc7509-9805-4511-b0cc-e9c67b676321 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-9efc7509-9805-4511-b0cc-e9c67b676321" returned: 0 in 0.877s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-9efc7509-9805-4511-b0cc-e9c67b676321 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-9efc7509-9805-4511-b0cc-e9c67b676321" returned: 0 in 0.242s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Lock "cinder-quobyte-9efc7509-9805-4511-b0cc-e9c67b676321" released by "delete_volume" :: held 1.344s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Created reservations ['1b38cf43-bb78-4227-8268-12164a1d33a2'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:42:02 devstack cinder-volume[82799]: WARNING cinder.quota [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1061511717 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1061511717, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:42:02 devstack cinder-volume[82799]: WARNING cinder.quota [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1061511717 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1061511717, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Created reservations ['2cf5e4d1-09ee-409c-baab-8346619c3a5c', 'e02a8c9d-3c1f-4722-9281-46ffec9bf1e7', 'f3d7a504-5f67-4f9c-9e23-1a4c694179d6', 'cc0333cd-eb4e-4260-bd30-1590f71635cf'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.137s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:03 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:42:03 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ad42e259-12ef-41e9-ac58-c20d1f6cc874 tempest-GroupsTest-1028365635 None] Delete group completed successfully.
Sep 18 13:42:03 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:03 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Created reservations ['cdd1782a-dbde-498b-ab94-b841a1126b7d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:42:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.223s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:04 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:42:04 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7edacc19-6585-44b7-9715-793c75601dd0 tempest-GroupsTest-1028365635 None] Delete group completed successfully.
Sep 18 13:42:06 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bef8cf8e-cb76-4b11-bb25-bf2fe78aabd3 tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bef8cf8e-cb76-4b11-bb25-bf2fe78aabd3 tempest-GroupsTest-1028365635 None] Group tempest-GroupsTest-Group-2056143152: creating
Sep 18 13:42:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bef8cf8e-cb76-4b11-bb25-bf2fe78aabd3 tempest-GroupsTest-1028365635 None] Group tempest-GroupsTest-Group-2056143152: created successfully
Sep 18 13:42:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bef8cf8e-cb76-4b11-bb25-bf2fe78aabd3 tempest-GroupsTest-1028365635 None] Create group completed successfully.
Sep 18 13:42:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-d80a2759-0ff3-4b3b-b959-d720ca59d547 req-c7f4faca-cc1d-4913-8197-e1a9229f238a tempest-TestMinimumBasicScenario-1462490838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-d80a2759-0ff3-4b3b-b959-d720ca59d547 req-c7f4faca-cc1d-4913-8197-e1a9229f238a tempest-TestMinimumBasicScenario-1462490838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:06 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a484accc-b913-4db1-b33a-1b4092ee9703]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:42:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-d80a2759-0ff3-4b3b-b959-d720ca59d547 req-c7f4faca-cc1d-4913-8197-e1a9229f238a tempest-TestMinimumBasicScenario-1462490838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:08 devstack quobyte-client[82822]: System call of process 92929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:42:08 devstack quobyte-client[82822]: System call of process 92929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:42:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-d80a2759-0ff3-4b3b-b959-d720ca59d547 req-c7f4faca-cc1d-4913-8197-e1a9229f238a tempest-TestMinimumBasicScenario-1462490838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d" returned: 0 in 1.813s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-d80a2759-0ff3-4b3b-b959-d720ca59d547 req-c7f4faca-cc1d-4913-8197-e1a9229f238a tempest-TestMinimumBasicScenario-1462490838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-d80a2759-0ff3-4b3b-b959-d720ca59d547 req-c7f4faca-cc1d-4913-8197-e1a9229f238a tempest-TestMinimumBasicScenario-1462490838 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-11af8750-2729-486f-8d1c-7ecf8399ad6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6699a644-363c-4672-831d-8132e609c9e0', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:42:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-d80a2759-0ff3-4b3b-b959-d720ca59d547 req-c7f4faca-cc1d-4913-8197-e1a9229f238a tempest-TestMinimumBasicScenario-1462490838 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Flow 'volume_create_manager' (0c2e2744-f2e8-43d2-b365-a9662d7c8308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee42b7f-49b3-45da-8815-8c01b5d2ea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee42b7f-49b3-45da-8815-8c01b5d2ea81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1005099279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eda701d4-7c84-42cd-9607-b479ff218746,host='devstack@QuobyteHD#QuobyteHD',id=07d27800-e7fa-42ac-9b7d-a1c5e4155f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce72c15436ba4787858562d4b4f9d85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:42:09Z,use_quota=True,user_id='e86b7bb8e8374fc4b6809fc34d0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71159755-e11c-4c58-85ae-dd36e444813a),volume_type_id=71159755-e11c-4c58-85ae-dd36e444813a)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6174f49f-e737-4b58-b73b-e6b62fa3b523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6174f49f-e737-4b58-b73b-e6b62fa3b523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26d0483-4839-4cd4-baf0-a5f4f12cd0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26d0483-4839-4cd4-baf0-a5f4f12cd0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d27800-e7fa-42ac-9b7d-a1c5e4155f15', 'volume_name': 'volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6166dc83-45c2-4728-9434-0e52d5681774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6166dc83-45c2-4728-9434-0e52d5681774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db221f6-6288-4cdf-97b3-b9011a991699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:09 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Volume 07d27800-e7fa-42ac-9b7d-a1c5e4155f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15', 'volume_size': 1}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eda701d4-7c84-42cd-9607-b479ff218746,created_at=2025-09-18T11:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1005099279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eda701d4-7c84-42cd-9607-b479ff218746,host='devstack@QuobyteHD#QuobyteHD',id=07d27800-e7fa-42ac-9b7d-a1c5e4155f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce72c15436ba4787858562d4b4f9d85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:42:09Z,use_quota=True,user_id='e86b7bb8e8374fc4b6809fc34d0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71159755-e11c-4c58-85ae-dd36e444813a),volume_type_id=71159755-e11c-4c58-85ae-dd36e444813a)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Creating volume 07d27800-e7fa-42ac-9b7d-a1c5e4155f15 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:42:09 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:42:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:09 devstack quobyte-client[82822]: System call of process 92933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:42:09 devstack quobyte-client[82822]: System call of process 92933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:42:10 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=58, name=volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:42:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-d80a2759-0ff3-4b3b-b959-d720ca59d547 req-c7f4faca-cc1d-4913-8197-e1a9229f238a tempest-TestMinimumBasicScenario-1462490838 None] attachment_update completed successfully.
Sep 18 13:42:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15 1073741824" returned: 0 in 0.810s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15" returned: 0 in 0.105s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] <== create_volume: return (992ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:42:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db221f6-6288-4cdf-97b3-b9011a991699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ff263a-8775-433c-9dde-9165c5614b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Volume volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15 (07d27800-e7fa-42ac-9b7d-a1c5e4155f15): created successfully
Sep 18 13:42:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ff263a-8775-433c-9dde-9165c5614b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Flow 'volume_create_manager' (0c2e2744-f2e8-43d2-b365-a9662d7c8308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:42:11 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-fa75c7dc-0a49-4c02-bfab-3ee693582a96 tempest-GroupsTest-1028365635 None] Created volume successfully.
Sep 18 13:42:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:42:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.192s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:42:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:16 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Flow 'volume_create_manager' (b3a2d298-d862-4e1b-b045-38b4c5787a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca8243d-007d-4392-9663-961e2a651527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca8243d-007d-4392-9663-961e2a651527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512056796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eda701d4-7c84-42cd-9607-b479ff218746,host='devstack@QuobyteHD#QuobyteHD',id=88f645b1-d8dc-4a7d-a7d3-8e99b581b81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce72c15436ba4787858562d4b4f9d85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:42:16Z,use_quota=True,user_id='e86b7bb8e8374fc4b6809fc34d0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71159755-e11c-4c58-85ae-dd36e444813a),volume_type_id=71159755-e11c-4c58-85ae-dd36e444813a)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae2d777-7c0d-4f06-b836-4c1f21d2b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae2d777-7c0d-4f06-b836-4c1f21d2b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34261f6-c352-4648-8ee8-c9820eaa750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34261f6-c352-4648-8ee8-c9820eaa750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f645b1-d8dc-4a7d-a7d3-8e99b581b81d', 'volume_name': 'volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c8b7e6-54d7-4255-b1c9-48ea80b82239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c8b7e6-54d7-4255-b1c9-48ea80b82239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6033190e-bd2a-4a2e-9e0e-dd1572d7febd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:17 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Volume 88f645b1-d8dc-4a7d-a7d3-8e99b581b81d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d', 'volume_size': 1}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eda701d4-7c84-42cd-9607-b479ff218746,created_at=2025-09-18T11:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512056796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eda701d4-7c84-42cd-9607-b479ff218746,host='devstack@QuobyteHD#QuobyteHD',id=88f645b1-d8dc-4a7d-a7d3-8e99b581b81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce72c15436ba4787858562d4b4f9d85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:42:16Z,use_quota=True,user_id='e86b7bb8e8374fc4b6809fc34d0dc0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71159755-e11c-4c58-85ae-dd36e444813a),volume_type_id=71159755-e11c-4c58-85ae-dd36e444813a)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Creating volume 88f645b1-d8dc-4a7d-a7d3-8e99b581b81d {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:42:17 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:42:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:17 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=59, name=volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:42:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d 1073741824" returned: 0 in 0.649s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d" returned: 0 in 0.407s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] <== create_volume: return (1287ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:42:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6033190e-bd2a-4a2e-9e0e-dd1572d7febd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea7fb7d-040a-4d63-8d47-4e90085cc345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:19 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Volume volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d (88f645b1-d8dc-4a7d-a7d3-8e99b581b81d): created successfully
Sep 18 13:42:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea7fb7d-040a-4d63-8d47-4e90085cc345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Flow 'volume_create_manager' (b3a2d298-d862-4e1b-b045-38b4c5787a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:42:19 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-aa6d5115-8cce-49d1-906e-1656f3d903e3 tempest-GroupsTest-1028365635 None] Created volume successfully.
Sep 18 13:42:20 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ab747b4c-df77-48bc-80d7-b6e8a2cfc06b tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:20 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ab747b4c-df77-48bc-80d7-b6e8a2cfc06b tempest-GroupsTest-1028365635 None] Update group completed successfully.
Sep 18 13:42:22 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0ab29864-8031-49df-a58b-0135497ae5eb tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:22 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0ab29864-8031-49df-a58b-0135497ae5eb tempest-GroupsTest-1028365635 None] Update group completed successfully.
Sep 18 13:42:24 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:24 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Acquiring lock "cinder-quobyte-07d27800-e7fa-42ac-9b7d-a1c5e4155f15" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:42:24 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Lock "cinder-quobyte-07d27800-e7fa-42ac-9b7d-a1c5e4155f15" acquired by "delete_volume" :: waited 0.039s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:42:24 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[197cbbb6-5378-473f-9bd9-abbc015ed9ed]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:42:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15" returned: 0 in 0.558s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07d27800-e7fa-42ac-9b7d-a1c5e4155f15" returned: 0 in 0.140s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Lock "cinder-quobyte-07d27800-e7fa-42ac-9b7d-a1c5e4155f15" released by "delete_volume" :: held 1.035s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:42:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Acquiring lock "cinder-quobyte-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:42:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Lock "cinder-quobyte-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d" acquired by "delete_volume" :: waited 0.129s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:42:25 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[854b8580-1009-4792-85dc-902b22e8e55d]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:42:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:26 devstack quobyte-client[82822]: System call of process 93375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:42:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d" returned: 0 in 1.058s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d" returned: 0 in 0.351s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Lock "cinder-quobyte-88f645b1-d8dc-4a7d-a7d3-8e99b581b81d" released by "delete_volume" :: held 2.017s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:42:29 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Created reservations ['c5f803b0-5696-4f55-8737-396b68695f4c'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:42:29 devstack cinder-volume[82799]: WARNING cinder.quota [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1150942600 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1150942600, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:42:29 devstack cinder-volume[82799]: WARNING cinder.quota [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1150942600 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1150942600, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:42:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "cinder-8d15d716-b132-48e1-9987-9d976a30db88-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:42:29 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Created reservations ['be41c0d7-4060-4e15-9be3-e057edc8174e', '20f86262-05ac-471c-be80-34da5904a1d3', '65fcaafc-7fa3-4d47-99ea-093092533d31', '3e15266d-0dca-4292-97ae-44524266b2e7'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:42:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "cinder-8d15d716-b132-48e1-9987-9d976a30db88-delete_volume" acquired by "delete_volume" :: waited 0.181s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:42:30 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "cinder-quobyte-8d15d716-b132-48e1-9987-9d976a30db88" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:42:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "cinder-quobyte-8d15d716-b132-48e1-9987-9d976a30db88" acquired by "delete_volume" :: waited 0.096s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:42:30 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceba39d-5051-416a-85db-d79039b8e161]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:42:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8d15d716-b132-48e1-9987-9d976a30db88 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:31 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Created reservations ['51b578d6-06f7-4468-bc72-89b48a35e1ae', '9e7a7722-c3db-4108-85fb-51e59386b873', 'bbc25132-5df3-40d6-89c6-dae65332c334', '9785bfac-409d-4581-96dd-30adb170fb13'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:42:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8d15d716-b132-48e1-9987-9d976a30db88" returned: 0 in 2.888s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8d15d716-b132-48e1-9987-9d976a30db88 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.839s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:34 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:42:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8d15d716-b132-48e1-9987-9d976a30db88" returned: 0 in 0.834s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7e98c245-01fb-4841-bcfe-c09674f33f08 tempest-GroupsTest-1028365635 None] Delete group completed successfully.
Sep 18 13:42:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "cinder-quobyte-8d15d716-b132-48e1-9987-9d976a30db88" released by "delete_volume" :: held 4.272s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:42:35 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Created reservations ['bbecfac8-7241-4b68-866e-cbe1d7bc0c08', 'd360c159-09ae-4bd5-bce1-004f660a53c8', '8930090c-be16-4663-a2ae-fbdf625d2adf', '82fbff13-613f-4705-bd0b-931a257d2bec'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:42:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.186s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:36 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:42:36 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Deleted volume successfully.
Sep 18 13:42:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "cinder-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:42:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6a0f0a5e-0f95-4f50-81ae-3cf1c44585c8 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "cinder-8d15d716-b132-48e1-9987-9d976a30db88-delete_volume" released by "delete_volume" :: held 7.156s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:42:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "cinder-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:42:37 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "cinder-quobyte-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:42:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "cinder-quobyte-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8" acquired by "delete_volume" :: waited 0.023s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:42:37 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9ee263-c883-4a95-98c9-63939f5de0dc]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:42:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8" returned: 0 in 0.783s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8" returned: 0 in 0.306s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "cinder-quobyte-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8" released by "delete_volume" :: held 1.376s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:42:39 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Created reservations ['d409c946-a69c-46b3-89e9-7c5873a00890', '99a515bf-b6ff-45d7-983e-578a5f9b1e62', '37f429e8-4389-4915-bdf4-edeef801756c', 'd7488215-e9c5-4f56-8863-1121e32b6790'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:42:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.323s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:39 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:42:39 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Deleted volume successfully.
Sep 18 13:42:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2404e90-cb17-4dd1-ad36-e4ac6a2feee2 tempest-AttachVolumeShelveTestJSON-1618960657 None] Lock "cinder-4abbbdb0-587f-4ce2-9107-0d3f99d3c8a8-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:42:49 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=62,cinder:UPDATE=63,cinder:DELETE=2,cinder:INSERT=11 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:42:50 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=61,cinder:SELECT=51,cinder:INSERT=12,cinder:DELETE=4 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:42:54 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Flow 'volume_create_manager' (952c2eb6-e391-4188-801f-c53d09e58c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa953ce-c25c-41e9-9bf0-aadf686abfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa953ce-c25c-41e9-9bf0-aadf686abfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-787124668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7686e7f49f604ef4a77cc1e04e1e1a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:42:54Z,use_quota=True,user_id='f78275ca45d94dd785361e8512daef0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed7e9f10-4643-4714-80de-568173e875e4),volume_type_id=ed7e9f10-4643-4714-80de-568173e875e4)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b208255-d061-4b8d-907f-0407a7e7af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b208255-d061-4b8d-907f-0407a7e7af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0dd70b-7bf5-4133-97a9-d57d32c7b3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0dd70b-7bf5-4133-97a9-d57d32c7b3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108', 'volume_name': 'volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bac2d08-a874-43cc-8111-c8a1b2003944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bac2d08-a874-43cc-8111-c8a1b2003944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd6ff7e-c64f-4038-8fbc-b45f93f73c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:54 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Volume fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108', 'volume_size': 1}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-787124668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7686e7f49f604ef4a77cc1e04e1e1a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:42:54Z,use_quota=True,user_id='f78275ca45d94dd785361e8512daef0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed7e9f10-4643-4714-80de-568173e875e4),volume_type_id=ed7e9f10-4643-4714-80de-568173e875e4)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Creating volume fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:42:54 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:42:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:54 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=60, name=volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:42:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108 1073741824" returned: 0 in 0.533s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108" returned: 0 in 0.143s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] <== create_volume: return (814ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:42:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd6ff7e-c64f-4038-8fbc-b45f93f73c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf3cf82-554f-49f3-93fd-67045ed63974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:42:55 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Volume volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108 (fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108): created successfully
Sep 18 13:42:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf3cf82-554f-49f3-93fd-67045ed63974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:42:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Flow 'volume_create_manager' (952c2eb6-e391-4188-801f-c53d09e58c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:42:55 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bfe71941-8951-4ae8-b449-d5772ef44ed7 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Created volume successfully.
Sep 18 13:42:56 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:42:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:42:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:42:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:42:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:42:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:42:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:42:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.334s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:42:57 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:42:58 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-86cbd0b1-65d1-4676-9c46-16fdb9887cba tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Retype volume completed successfully.
Sep 18 13:42:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Acquiring lock "cinder-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:42:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "cinder-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108-delete_volume" acquired by "delete_volume" :: waited 0.201s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:43:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:43:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Acquiring lock "cinder-quobyte-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:43:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "cinder-quobyte-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108" acquired by "delete_volume" :: waited 0.035s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:43:00 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[487fd124-4319-4833-9293-820f9002738b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:43:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:43:01 devstack quobyte-client[82822]: System call of process 93528 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:43:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108" returned: 0 in 1.559s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:43:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:43:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108" returned: 0 in 0.153s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:43:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "cinder-quobyte-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108" released by "delete_volume" :: held 2.008s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:43:02 devstack cinder-volume[82799]: WARNING cinder.quota [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:43:02 devstack cinder-volume[82799]: WARNING cinder.quota [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 18 13:43:02 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Created reservations ['947dc755-3319-45d9-9170-bdb67b83c5f1', '0e049bde-0c41-436f-970d-ced4e434d7e1', '2ab4250a-4144-44a7-b5fb-af339fa9c22a', '9d1aa733-8451-4601-a487-b95f3bef22e6'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:43:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:43:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:43:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:43:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:43:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:43:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:43:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.388s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:43:03 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:43:04 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Deleted volume successfully.
Sep 18 13:43:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-edb4fb12-990e-4320-b0ae-919b763733f0 tempest-VolumeRetypeWithoutMigrationTest-1523210818 None] Lock "cinder-fcdfe5af-c54d-4f1a-bfc4-bbad9a30c108-delete_volume" released by "delete_volume" :: held 5.461s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:43:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:43:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:43:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:43:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:43:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:43:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:43:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:43:13 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=11,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=4 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:43:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.526s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:43:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:43:14 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=20,cinder:SELECT=15,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:43:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:44:01 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:01 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:44:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Flow 'volume_create_manager' (dd1ca4fb-be19-432e-996d-beb4077e6020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:44:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4169e52-11c5-4fe7-9dce-1ae1a262a3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4169e52-11c5-4fe7-9dce-1ae1a262a3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-109619157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a45e73-14fa-471e-9965-23a0c1ae4b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbecc7fea114a1e9d4bedd15f082333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:44:01Z,use_quota=True,user_id='2060e248e3a94819914591a546af0da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944b86dd-3ce8-41a9-9be1-c4ba2567f434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944b86dd-3ce8-41a9-9be1-c4ba2567f434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d36bac2-0419-47e5-83ae-e9af8035ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:01 devstack cinder-volume[82799]: DEBUG cinder.image.glance [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Creating Keystone auth plugin from conf {{(pid=82799) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 13:44:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d36bac2-0419-47e5-83ae-e9af8035ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95a45e73-14fa-471e-9965-23a0c1ae4b13', 'volume_name': 'volume-95a45e73-14fa-471e-9965-23a0c1ae4b13', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c3b7c10>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555f5050-928a-4a95-82e3-05e894fa56f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555f5050-928a-4a95-82e3-05e894fa56f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d39257-9062-4e48-85e9-0a7365aa702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:02 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Volume 95a45e73-14fa-471e-9965-23a0c1ae4b13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95a45e73-14fa-471e-9965-23a0c1ae4b13', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c3b7c10>}
Sep 18 13:44:02 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Cloning 95a45e73-14fa-471e-9965-23a0c1ae4b13 from image bcfddd9f-68c0-4f36-86c6-1809e131a4ca  at location (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]). {{(pid=82799) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 13:44:02 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 13:44:02 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 13:44:02 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ac3d9-4c0a-4370-b12e-4b5cbade7f55]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:03 devstack sudo[93815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD
Sep 18 13:44:03 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:44:04 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root
Sep 18 13:44:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD" returned: 0 in 2.183s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:04 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Temporary image bcfddd9f-68c0-4f36-86c6-1809e131a4ca is fetched for user 2060e248e3a94819914591a546af0da6. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 13:44:05 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd073989-fc33-46ed-b3e6-9eef2601329c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:05 devstack sudo[93820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD
Sep 18 13:44:05 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:44:07 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD" returned: 0 in 2.261s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-109619157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a45e73-14fa-471e-9965-23a0c1ae4b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbecc7fea114a1e9d4bedd15f082333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:44:01Z,use_quota=True,user_id='2060e248e3a94819914591a546af0da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Creating volume 95a45e73-14fa-471e-9965-23a0c1ae4b13 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:44:07 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:44:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:07 devstack quobyte-client[82822]: System call of process 93825 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:44:08 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=61, name=volume-95a45e73-14fa-471e-9965-23a0c1ae4b13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:44:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 1073741824" returned: 0 in 0.914s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13" returned: 0 in 0.130s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] <== create_volume: return (1179ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:44:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:09 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Attempting download of bcfddd9f-68c0-4f36-86c6-1809e131a4ca ((None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}])) to volume 95a45e73-14fa-471e-9965-23a0c1ae4b13. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 13:44:09 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae08da9-0626-40c7-83f2-97ca2ac0f462]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_t5w2sspr {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_t5w2sspr" returned: 0 in 0.442s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_t5w2sspr {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_t5w2sspr" returned: 1 in 0.526s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_t5w2sspr' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:44:10 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3314b2-baa5-4ece-9f78-23e81365ff55]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD" returned: 0 in 0.572s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:11 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] bcfddd9f-68c0-4f36-86c6-1809e131a4ca was qcow2, converting to raw {{(pid=82799) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 13:44:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:11 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=61, name=volume-95a45e73-14fa-471e-9965-23a0c1ae4b13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:44:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:44:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:44:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:44:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.233s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:44:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13" returned: 0 in 2.120s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:13 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_fh40sn6gdevstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:44:13 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Converted 112.00 MB image at 52.35 MB/s
Sep 18 13:44:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 1G" returned: 0 in 0.265s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:13 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc5f14b-9702-466b-bb48-0f5dc65a7238]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13" returned: 0 in 0.627s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13" returned: 1 in 0.659s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Downloaded image bcfddd9f-68c0-4f36-86c6-1809e131a4ca ((None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}])) to volume 95a45e73-14fa-471e-9965-23a0c1ae4b13 successfully. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Temporary image bcfddd9f-68c0-4f36-86c6-1809e131a4ca for user 2060e248e3a94819914591a546af0da6 is deleted. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Marking volume 95a45e73-14fa-471e-9965-23a0c1ae4b13 as bootable. {{(pid=82799) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Copying metadata from image bcfddd9f-68c0-4f36-86c6-1809e131a4ca to 95a45e73-14fa-471e-9965-23a0c1ae4b13. {{(pid=82799) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Creating volume glance metadata for volume 95a45e73-14fa-471e-9965-23a0c1ae4b13 backed by image bcfddd9f-68c0-4f36-86c6-1809e131a4ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82799) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d39257-9062-4e48-85e9-0a7365aa702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a45e73-14fa-471e-9965-23a0c1ae4b13', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c3b7c10>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb39e192-6efc-4b6c-82f4-27bfa75972bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:15 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Volume volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 (95a45e73-14fa-471e-9965-23a0c1ae4b13): created successfully
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb39e192-6efc-4b6c-82f4-27bfa75972bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Flow 'volume_create_manager' (dd1ca4fb-be19-432e-996d-beb4077e6020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:44:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9c3c0bbb-8284-431c-8cbb-f057235a5875 tempest-VolumesImageMetadata-779214374 None] Created volume successfully.
Sep 18 13:44:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Acquiring lock "cinder-95a45e73-14fa-471e-9965-23a0c1ae4b13-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:44:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Lock "cinder-95a45e73-14fa-471e-9965-23a0c1ae4b13-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:44:17 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Acquiring lock "cinder-quobyte-95a45e73-14fa-471e-9965-23a0c1ae4b13" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:44:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Lock "cinder-quobyte-95a45e73-14fa-471e-9965-23a0c1ae4b13" acquired by "delete_volume" :: waited 0.028s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:44:17 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e149915-6fe9-4139-9bd8-60c36e0ea022]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13" returned: 0 in 0.519s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13" returned: 1 in 0.788s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:44:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-95a45e73-14fa-471e-9965-23a0c1ae4b13" returned: 0 in 0.145s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:19 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Lock "cinder-quobyte-95a45e73-14fa-471e-9965-23a0c1ae4b13" released by "delete_volume" :: held 1.816s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:44:19 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Created reservations ['6baf13ae-cd08-4501-bf0b-505c8ba7e259', '37a0036d-b76c-4304-942e-16097ef96d69', '8db5acb7-628b-4a80-96f3-0f41b1c025ad', '7cd863f5-7192-4056-ad3a-b056f7cafb6a'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:44:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:44:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:44:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.124s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:20 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:44:20 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Deleted volume successfully.
Sep 18 13:44:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2d947f34-4d12-4b03-93ce-81b3a11ba5c3 tempest-VolumesImageMetadata-779214374 None] Lock "cinder-95a45e73-14fa-471e-9965-23a0c1ae4b13-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:44:25 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:25 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:44:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Flow 'volume_create_manager' (d25582f8-628c-4bb5-8116-c34868241c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:44:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a37ac0-e771-4eda-957a-90e65b8e42f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a37ac0-e771-4eda-957a-90e65b8e42f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1215690503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067ae374-717d-4090-8110-3381c75c1d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c386cea6c546d09c77dcc3dcd419aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:44:26Z,use_quota=True,user_id='94f6bcacbf4e41b0a6064f830026f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc53e5-e31f-4a15-8802-299f7ec62a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc53e5-e31f-4a15-8802-299f7ec62a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a239bfe8-f0ae-4aae-b07d-088a6b8be66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a239bfe8-f0ae-4aae-b07d-088a6b8be66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '067ae374-717d-4090-8110-3381c75c1d75', 'volume_name': 'volume-067ae374-717d-4090-8110-3381c75c1d75', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac77ef2-8cf0-40b8-b06e-edf6a39ee717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac77ef2-8cf0-40b8-b06e-edf6a39ee717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a448763-ce34-4b84-8ac0-87f3b017dc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:26 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Volume 067ae374-717d-4090-8110-3381c75c1d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-067ae374-717d-4090-8110-3381c75c1d75', 'volume_size': 1}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1215690503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067ae374-717d-4090-8110-3381c75c1d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c386cea6c546d09c77dcc3dcd419aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:44:26Z,use_quota=True,user_id='94f6bcacbf4e41b0a6064f830026f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Creating volume 067ae374-717d-4090-8110-3381c75c1d75 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:44:26 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:26 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=62, name=volume-067ae374-717d-4090-8110-3381c75c1d75, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 1073741824" returned: 0 in 0.631s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75" returned: 0 in 0.141s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] <== create_volume: return (858ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:44:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a448763-ce34-4b84-8ac0-87f3b017dc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067ae374-717d-4090-8110-3381c75c1d75', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d962af8f-93ca-462a-bbe1-adbbd107dd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:27 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Volume volume-067ae374-717d-4090-8110-3381c75c1d75 (067ae374-717d-4090-8110-3381c75c1d75): created successfully
Sep 18 13:44:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d962af8f-93ca-462a-bbe1-adbbd107dd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Flow 'volume_create_manager' (d25582f8-628c-4bb5-8116-c34868241c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:44:27 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7cfee5fb-5742-4031-8dff-088b69c2b91a tempest-SnapshotMetadataTestJSON-492230844 None] Created volume successfully.
Sep 18 13:44:28 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Creating offline snapshot 090803c4-a583-430b-8a5f-3332735528f5 of volume 067ae374-717d-4090-8110-3381c75c1d75 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:44:28 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cb6614-c1b9-4e6c-a0f8-53df8bd020e5]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75" returned: 0 in 0.609s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:29 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=63, name=volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:44:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 1G" returned: 0 in 0.367s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): qemu-img rebase -u -b volume-067ae374-717d-4090-8110-3381c75c1d75 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "qemu-img rebase -u -b volume-067ae374-717d-4090-8110-3381c75c1d75 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5" returned: 0 in 0.408s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:44:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5" returned: 0 in 0.257s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:44:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5" returned: 0 in 0.313s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.info" returned: 0 in 0.304s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:44:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.info" returned: 0 in 0.335s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.602s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:33 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8e5d0873-c12d-4740-b094-9047469298f2 tempest-SnapshotMetadataTestJSON-492230844 None] Create snapshot completed successfully
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Acquiring lock "cinder-090803c4-a583-430b-8a5f-3332735528f5-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-090803c4-a583-430b-8a5f-3332735528f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.129s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:44:36 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Acquiring lock "cinder-quobyte-067ae374-717d-4090-8110-3381c75c1d75" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-quobyte-067ae374-717d-4090-8110-3381c75c1d75" acquired by "delete_snapshot" :: waited 0.060s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Acquiring lock "cinder-quobyte-090803c4-a583-430b-8a5f-3332735528f5" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-quobyte-090803c4-a583-430b-8a5f-3332735528f5" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Deleting offline snapshot 090803c4-a583-430b-8a5f-3332735528f5 of volume 067ae374-717d-4090-8110-3381c75c1d75 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] snapshot_file for this snap is: volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f476fc4-66cb-4830-81f3-794e3ba68469]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5" returned: 0 in 2.089s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-067ae374-717d-4090-8110-3381c75c1d75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:44:38 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee44de1-85c6-4fa5-bb90-74b3d6e3b9bb]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75" returned: 0 in 0.572s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5" returned: 0 in 0.317s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75.090803c4-a583-430b-8a5f-3332735528f5" returned: 0 in 0.138s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-quobyte-090803c4-a583-430b-8a5f-3332735528f5" released by "_delete_snapshot" :: held 3.658s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:44:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-quobyte-067ae374-717d-4090-8110-3381c75c1d75" released by "delete_snapshot" :: held 3.708s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:44:40 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Created reservations ['c9f8e111-c068-42dd-a637-8f0e9a597647', '5ccaf91f-0abc-4ad4-b6bb-aeb285172333', '97a49166-e632-4fec-bb0e-2dc203004f30', '9d302b72-0218-48ba-bd48-f18f16665a61'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:44:40 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Delete snapshot completed successfully.
Sep 18 13:44:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f17a2002-132c-407a-bd56-e51477384438 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-090803c4-a583-430b-8a5f-3332735528f5-delete_snapshot" released by "delete_snapshot" :: held 4.286s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:44:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Acquiring lock "cinder-067ae374-717d-4090-8110-3381c75c1d75-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:44:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-067ae374-717d-4090-8110-3381c75c1d75-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:44:41 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Acquiring lock "cinder-quobyte-067ae374-717d-4090-8110-3381c75c1d75" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:44:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-quobyte-067ae374-717d-4090-8110-3381c75c1d75" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:44:41 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d51f469-bfe0-465c-9018-ba7f8581e66d]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75" returned: 0 in 0.449s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-067ae374-717d-4090-8110-3381c75c1d75" returned: 0 in 0.094s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-quobyte-067ae374-717d-4090-8110-3381c75c1d75" released by "delete_volume" :: held 0.729s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Created reservations ['6486bdf3-3497-4119-8f7e-318e7b360dcf', '66e31b32-0440-4a9f-ae61-1034d651f5eb', 'a7e5f974-f31d-4484-8749-ed0d16d3040b', '5dca99c3-680f-4536-8468-62617d174ce4'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.079s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:44:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Deleted volume successfully.
Sep 18 13:44:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b41b2f79-668b-476e-808a-77a5d05e16e6 tempest-SnapshotMetadataTestJSON-492230844 None] Lock "cinder-067ae374-717d-4090-8110-3381c75c1d75-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:44:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Flow 'volume_create_manager' (2a52a3ef-5435-47e0-acaa-4507d086029f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf3e982-fe6e-4b4b-a89c-a16242cbca07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf3e982-fe6e-4b4b-a89c-a16242cbca07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1267121347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a1618d-51f4-44b7-bc18-f2d534030d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf22c6a6810841829a8c8faaa5cb258f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:44:47Z,use_quota=True,user_id='9e5899c96c644569a60c4b8c20654fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7824872f-2335-4e9a-9031-508bb75964fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7824872f-2335-4e9a-9031-508bb75964fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614de4db-5cfb-45c4-a4a0-a5967f1dd0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614de4db-5cfb-45c4-a4a0-a5967f1dd0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a1618d-51f4-44b7-bc18-f2d534030d13', 'volume_name': 'volume-78a1618d-51f4-44b7-bc18-f2d534030d13', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b3f7a6-75a1-4266-913c-65dcb4633ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b3f7a6-75a1-4266-913c-65dcb4633ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b557303-370e-4e58-9cb8-af980e9b7015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:47 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Volume 78a1618d-51f4-44b7-bc18-f2d534030d13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a1618d-51f4-44b7-bc18-f2d534030d13', 'volume_size': 1}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1267121347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a1618d-51f4-44b7-bc18-f2d534030d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf22c6a6810841829a8c8faaa5cb258f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:44:47Z,use_quota=True,user_id='9e5899c96c644569a60c4b8c20654fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Creating volume 78a1618d-51f4-44b7-bc18-f2d534030d13 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:44:47 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78a1618d-51f4-44b7-bc18-f2d534030d13 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:47 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=65, name=volume-78a1618d-51f4-44b7-bc18-f2d534030d13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78a1618d-51f4-44b7-bc18-f2d534030d13 1073741824" returned: 0 in 0.406s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78a1618d-51f4-44b7-bc18-f2d534030d13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78a1618d-51f4-44b7-bc18-f2d534030d13" returned: 0 in 0.096s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] <== create_volume: return (593ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:44:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.607s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b557303-370e-4e58-9cb8-af980e9b7015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a1618d-51f4-44b7-bc18-f2d534030d13', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0670486-8a1a-4fb4-88c4-d2ece660c0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:48 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Volume volume-78a1618d-51f4-44b7-bc18-f2d534030d13 (78a1618d-51f4-44b7-bc18-f2d534030d13): created successfully
Sep 18 13:44:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0670486-8a1a-4fb4-88c4-d2ece660c0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Flow 'volume_create_manager' (2a52a3ef-5435-47e0-acaa-4507d086029f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:44:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-df10350c-2ee2-41d3-b5b3-2e4a428bc3bc tempest-AbsoluteLimitsTests-1639406980 None] Created volume successfully.
Sep 18 13:44:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Acquiring lock "cinder-78a1618d-51f4-44b7-bc18-f2d534030d13-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:44:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Lock "cinder-78a1618d-51f4-44b7-bc18-f2d534030d13-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:44:49 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Acquiring lock "cinder-quobyte-78a1618d-51f4-44b7-bc18-f2d534030d13" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:44:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Lock "cinder-quobyte-78a1618d-51f4-44b7-bc18-f2d534030d13" acquired by "delete_volume" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:44:49 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[08728528-6999-4399-b315-b846f3596b39]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:44:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78a1618d-51f4-44b7-bc18-f2d534030d13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78a1618d-51f4-44b7-bc18-f2d534030d13" returned: 0 in 0.457s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78a1618d-51f4-44b7-bc18-f2d534030d13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-78a1618d-51f4-44b7-bc18-f2d534030d13" returned: 0 in 0.105s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Lock "cinder-quobyte-78a1618d-51f4-44b7-bc18-f2d534030d13" released by "delete_volume" :: held 0.732s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:44:50 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Created reservations ['4f436745-b30a-4f4b-828f-f70f9b99a0a3', '15ac6d1c-90b8-41a1-9245-bbd9b96052cc', '69b23c4e-64e8-464f-9fe4-0198f5dbdae3', 'f604c3eb-526a-4772-8c18-05c7f9ac59fb'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:44:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:44:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:44:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.103s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:51 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:44:51 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Deleted volume successfully.
Sep 18 13:44:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-101d6fd8-623d-496b-a3ba-123e4fb5d5bd tempest-AbsoluteLimitsTests-1639406980 None] Lock "cinder-78a1618d-51f4-44b7-bc18-f2d534030d13-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:44:58 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:44:58 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=40,cinder:UPDATE=51,cinder:INSERT=24,cinder:DELETE=5 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:44:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Flow 'volume_create_manager' (82605e9b-bb9e-4b06-afc9-eb991947055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d78240c-af58-46a6-a43a-7a21ec86f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-72921695-0d0d-4e75-b801-7a966d986f47 req-772bb755-db12-493f-9d65-3e869fdafd07 tempest-TestMinimumBasicScenario-1462490838 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-72921695-0d0d-4e75-b801-7a966d986f47 req-772bb755-db12-493f-9d65-3e869fdafd07 tempest-TestMinimumBasicScenario-1462490838 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:44:59 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-72921695-0d0d-4e75-b801-7a966d986f47 req-772bb755-db12-493f-9d65-3e869fdafd07 tempest-TestMinimumBasicScenario-1462490838 None] Terminate volume connection completed successfully.
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-72921695-0d0d-4e75-b801-7a966d986f47 req-772bb755-db12-493f-9d65-3e869fdafd07 tempest-TestMinimumBasicScenario-1462490838 None] Deleting attachment 6699a644-363c-4672-831d-8132e609c9e0. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d78240c-af58-46a6-a43a-7a21ec86f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-159951084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cacf06-c41e-4136-9edb-880bb9138adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800f970af84340f8a8bea5d9443babb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:44:59Z,use_quota=True,user_id='a4c14017ce2f4642b4601e1edcce048a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf4ff6b-996c-4012-b9f7-0c6fcce48450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf4ff6b-996c-4012-b9f7-0c6fcce48450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1551b2-cd78-48e8-84d3-46441a1d9c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1551b2-cd78-48e8-84d3-46441a1d9c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cacf06-c41e-4136-9edb-880bb9138adb', 'volume_name': 'volume-61cacf06-c41e-4136-9edb-880bb9138adb', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d78bdf1-6f64-480f-9770-5a472c765216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d78bdf1-6f64-480f-9770-5a472c765216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb52c5cc-537a-4da8-aaae-e4f9ca16fd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:44:59 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Volume 61cacf06-c41e-4136-9edb-880bb9138adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cacf06-c41e-4136-9edb-880bb9138adb', 'volume_size': 1}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-159951084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cacf06-c41e-4136-9edb-880bb9138adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800f970af84340f8a8bea5d9443babb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:44:59Z,use_quota=True,user_id='a4c14017ce2f4642b4601e1edcce048a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Creating volume 61cacf06-c41e-4136-9edb-880bb9138adb {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:44:59 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61cacf06-c41e-4136-9edb-880bb9138adb 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:44:59 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=66, name=volume-61cacf06-c41e-4136-9edb-880bb9138adb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61cacf06-c41e-4136-9edb-880bb9138adb 1073741824" returned: 0 in 0.432s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:44:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61cacf06-c41e-4136-9edb-880bb9138adb {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61cacf06-c41e-4136-9edb-880bb9138adb" returned: 0 in 0.096s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] <== create_volume: return (623ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb52c5cc-537a-4da8-aaae-e4f9ca16fd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cacf06-c41e-4136-9edb-880bb9138adb', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586eb34c-3bb9-4e45-8aaa-747fa70df4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:00 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Volume volume-61cacf06-c41e-4136-9edb-880bb9138adb (61cacf06-c41e-4136-9edb-880bb9138adb): created successfully
Sep 18 13:45:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586eb34c-3bb9-4e45-8aaa-747fa70df4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Flow 'volume_create_manager' (82605e9b-bb9e-4b06-afc9-eb991947055e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:00 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8e4a8117-bb37-4f75-b973-4bcf6a17a1fb tempest-VolumesTransfersTest-1471050289 None] Created volume successfully.
Sep 18 13:45:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Acquiring lock "cinder-11af8750-2729-486f-8d1c-7ecf8399ad6d-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Lock "cinder-11af8750-2729-486f-8d1c-7ecf8399ad6d-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:01 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Acquiring lock "cinder-quobyte-11af8750-2729-486f-8d1c-7ecf8399ad6d" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Lock "cinder-quobyte-11af8750-2729-486f-8d1c-7ecf8399ad6d" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:01 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[af94d2b4-7499-4745-adf1-4fba678a01c9]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:45:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d" returned: 0 in 0.552s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-11af8750-2729-486f-8d1c-7ecf8399ad6d" returned: 0 in 0.129s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Lock "cinder-quobyte-11af8750-2729-486f-8d1c-7ecf8399ad6d" released by "delete_volume" :: held 0.910s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-02345a7a-2890-4c5f-8f04-fea014820278 tempest-VolumesTransfersTest-415346836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:02 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-02345a7a-2890-4c5f-8f04-fea014820278 tempest-VolumesTransfersTest-415346836 None] Transfer volume completed successfully.
Sep 18 13:45:02 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Created reservations ['d08d8189-158c-4a6b-8615-58e9ecfd0a83', 'd28ed899-35e9-4af9-bd4a-62a6d8fbf5c7', '5de8813f-4e5a-44b1-a311-7abf1288895d', '484580b6-970e-4665-bfa4-12a60f44e010'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:45:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.156s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:03 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:45:03 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Deleted volume successfully.
Sep 18 13:45:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c36f95cf-d914-4285-bc59-98e39ee8374d tempest-TestMinimumBasicScenario-1462490838 None] Lock "cinder-11af8750-2729-486f-8d1c-7ecf8399ad6d-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Acquiring lock "cinder-61cacf06-c41e-4136-9edb-880bb9138adb-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Lock "cinder-61cacf06-c41e-4136-9edb-880bb9138adb-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:04 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Acquiring lock "cinder-quobyte-61cacf06-c41e-4136-9edb-880bb9138adb" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Lock "cinder-quobyte-61cacf06-c41e-4136-9edb-880bb9138adb" acquired by "delete_volume" :: waited 0.028s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:04 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dcc7da-d713-4c4e-8353-4aafdb575e17]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:45:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61cacf06-c41e-4136-9edb-880bb9138adb {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61cacf06-c41e-4136-9edb-880bb9138adb" returned: 0 in 1.351s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61cacf06-c41e-4136-9edb-880bb9138adb {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61cacf06-c41e-4136-9edb-880bb9138adb" returned: 0 in 1.160s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:06 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:06 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Flow 'volume_create_manager' (1e355a79-2fb7-4785-ad08-86a0dc2a03c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d949a18-9f38-488d-a80e-58ab1446ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Lock "cinder-quobyte-61cacf06-c41e-4136-9edb-880bb9138adb" released by "delete_volume" :: held 3.038s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d949a18-9f38-488d-a80e-58ab1446ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-75217743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaa6c8a-e49f-4cdd-b780-caae0a925a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b28fd393a314010977f43f20e53f328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:05Z,use_quota=True,user_id='0efec3c24758429f9391a38d43a55269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46910f9d-5af6-479d-976a-d625b9f7d25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46910f9d-5af6-479d-976a-d625b9f7d25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d80f47b-cd14-4461-a5eb-48a1de0e850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d80f47b-cd14-4461-a5eb-48a1de0e850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdaa6c8a-e49f-4cdd-b780-caae0a925a8c', 'volume_name': 'volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb765d0-f648-406d-b667-a26af69f030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb765d0-f648-406d-b667-a26af69f030c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739ded87-2f72-4967-b630-509e68d6e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:07 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Volume bdaa6c8a-e49f-4cdd-b780-caae0a925a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c', 'volume_size': 1}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-75217743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaa6c8a-e49f-4cdd-b780-caae0a925a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b28fd393a314010977f43f20e53f328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:05Z,use_quota=True,user_id='0efec3c24758429f9391a38d43a55269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Creating volume bdaa6c8a-e49f-4cdd-b780-caae0a925a8c {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:45:07 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:45:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:07 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=67, name=volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:45:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c 1073741824" returned: 0 in 0.757s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:08 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Created reservations ['97f6f83b-1f9e-469b-baba-4c9944b9ab8d', '68fdf13b-1e8b-43ef-a64d-3bc7bbc0a07d', 'e9cf2843-a419-4e21-b892-dbbc81361098', 'fedc7380-1044-40d8-93c0-2c7bdda71efa'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:45:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c" returned: 0 in 0.592s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] <== create_volume: return (1426ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739ded87-2f72-4967-b630-509e68d6e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb06ef36-60a7-4fb0-897f-f792cc49aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:09 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Volume volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c (bdaa6c8a-e49f-4cdd-b780-caae0a925a8c): created successfully
Sep 18 13:45:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb06ef36-60a7-4fb0-897f-f792cc49aacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Flow 'volume_create_manager' (1e355a79-2fb7-4785-ad08-86a0dc2a03c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:09 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-773989c1-4b23-433c-82e3-3e2910a0b206 tempest-AttachVolumeTestJSON-1035035170 None] Created volume successfully.
Sep 18 13:45:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.703s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:45:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Deleted volume successfully.
Sep 18 13:45:10 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Flow 'volume_create_manager' (26a25cfe-e7b9-4354-9fd7-90f121d581b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6804f5ea-b07e-4d6b-b0f5-cb59b8e0f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-21ef280f-4cdb-43da-82af-4ad7fe0a8946 tempest-VolumesTransfersTest-227390405 None] Lock "cinder-61cacf06-c41e-4136-9edb-880bb9138adb-delete_volume" released by "delete_volume" :: held 6.870s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6804f5ea-b07e-4d6b-b0f5-cb59b8e0f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1794864758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c2fd6d-f75d-4b60-8f2a-596922968f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800f970af84340f8a8bea5d9443babb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:10Z,use_quota=True,user_id='a4c14017ce2f4642b4601e1edcce048a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f35517-f7d2-4976-8d39-0a91f3483661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f35517-f7d2-4976-8d39-0a91f3483661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f023d38-e961-4692-ab38-c64c159dec1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f023d38-e961-4692-ab38-c64c159dec1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c2fd6d-f75d-4b60-8f2a-596922968f78', 'volume_name': 'volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f768c8d-c57c-41df-b4b2-2c2dbaffe009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f768c8d-c57c-41df-b4b2-2c2dbaffe009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576e3868-c2a4-47b8-a6d4-6d371e98bbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:10 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Volume b4c2fd6d-f75d-4b60-8f2a-596922968f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78', 'volume_size': 1}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1794864758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c2fd6d-f75d-4b60-8f2a-596922968f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800f970af84340f8a8bea5d9443babb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:10Z,use_quota=True,user_id='a4c14017ce2f4642b4601e1edcce048a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Creating volume b4c2fd6d-f75d-4b60-8f2a-596922968f78 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:45:10 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:45:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:10 devstack quobyte-client[82822]: System call of process 94125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:45:10 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=68, name=volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:45:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78 1073741824" returned: 0 in 0.501s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78" returned: 0 in 0.125s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] <== create_volume: return (728ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576e3868-c2a4-47b8-a6d4-6d371e98bbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cfde98-a8c7-4095-88b9-71c2991d2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Volume volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78 (b4c2fd6d-f75d-4b60-8f2a-596922968f78): created successfully
Sep 18 13:45:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cfde98-a8c7-4095-88b9-71c2991d2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Flow 'volume_create_manager' (26a25cfe-e7b9-4354-9fd7-90f121d581b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:11 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-fecdba75-6e6e-4e38-a1da-b8635906dc81 tempest-VolumesTransfersTest-1471050289 None] Created volume successfully.
Sep 18 13:45:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:45:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.163s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:45:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Acquiring lock "cinder-b4c2fd6d-f75d-4b60-8f2a-596922968f78-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Lock "cinder-b4c2fd6d-f75d-4b60-8f2a-596922968f78-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:13 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Acquiring lock "cinder-quobyte-b4c2fd6d-f75d-4b60-8f2a-596922968f78" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Lock "cinder-quobyte-b4c2fd6d-f75d-4b60-8f2a-596922968f78" acquired by "delete_volume" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:13 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fe1bdf-a605-4488-aeca-45a51c26bfcd]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:45:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78" returned: 0 in 0.689s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b4c2fd6d-f75d-4b60-8f2a-596922968f78" returned: 0 in 0.429s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-1862c041-f6c4-4dae-b21f-3b4ae1d74630 req-78bfea8f-2370-4830-b939-8a8643f6f7cb tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-1862c041-f6c4-4dae-b21f-3b4ae1d74630 req-78bfea8f-2370-4830-b939-8a8643f6f7cb tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Lock "cinder-quobyte-b4c2fd6d-f75d-4b60-8f2a-596922968f78" released by "delete_volume" :: held 1.326s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:14 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c854d78-0bcf-46ad-9395-9784696cd5e9]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:45:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-1862c041-f6c4-4dae-b21f-3b4ae1d74630 req-78bfea8f-2370-4830-b939-8a8643f6f7cb tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-1862c041-f6c4-4dae-b21f-3b4ae1d74630 req-78bfea8f-2370-4830-b939-8a8643f6f7cb tempest-AttachVolumeTestJSON-1035035170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c" returned: 0 in 0.788s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-1862c041-f6c4-4dae-b21f-3b4ae1d74630 req-78bfea8f-2370-4830-b939-8a8643f6f7cb tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.882s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Created reservations ['fe4c96a4-32d5-49b5-9369-9a93da62ed26', '5792f79d-0854-4a9e-aeda-5ef4491141a7', 'd5453342-ea3b-47e1-96a1-5cbbf6d1ca8d', '8d8a1fbb-7f60-4a3a-a811-c3ebc781e393'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-1862c041-f6c4-4dae-b21f-3b4ae1d74630 req-78bfea8f-2370-4830-b939-8a8643f6f7cb tempest-AttachVolumeTestJSON-1035035170 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0e60db2-0dc2-44d5-be77-c760aebf2d0a', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:45:15 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-1862c041-f6c4-4dae-b21f-3b4ae1d74630 req-78bfea8f-2370-4830-b939-8a8643f6f7cb tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.375s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:16 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:45:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Deleted volume successfully.
Sep 18 13:45:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-1862c041-f6c4-4dae-b21f-3b4ae1d74630 req-78bfea8f-2370-4830-b939-8a8643f6f7cb tempest-AttachVolumeTestJSON-1035035170 None] attachment_update completed successfully.
Sep 18 13:45:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f1e57551-c2b7-46ad-a64d-133146ff2526 tempest-VolumesTransfersTest-227390405 None] Lock "cinder-b4c2fd6d-f75d-4b60-8f2a-596922968f78-delete_volume" released by "delete_volume" :: held 3.547s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=36,cinder:DELETE=2,cinder:SELECT=27,cinder:INSERT=7 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:45:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=4 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:45:30 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Flow 'volume_create_manager' (1e5eef7a-ce62-4c0e-ba8d-1c5f7c0eed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c16d002-a67c-48d6-96ad-30ba0acbde1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c16d002-a67c-48d6-96ad-30ba0acbde1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-763258446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad9c152-e2b5-4b6a-bf08-8a0452ee916b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735352a25ac147359725c96ca517fd3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:30Z,use_quota=True,user_id='840c31ed8f904fbbb0a098727c3fbabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c32c36-03dd-451b-8d7f-831bc43f41d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c32c36-03dd-451b-8d7f-831bc43f41d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d9ffbb-9bc2-4011-88fd-137e0947a45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d9ffbb-9bc2-4011-88fd-137e0947a45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad9c152-e2b5-4b6a-bf08-8a0452ee916b', 'volume_name': 'volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439728a9-1e24-4942-bcd8-f150ebc44f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439728a9-1e24-4942-bcd8-f150ebc44f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdc5158-61ca-4827-b67a-0059626b86b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:30 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Volume aad9c152-e2b5-4b6a-bf08-8a0452ee916b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b', 'volume_size': 1}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-763258446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad9c152-e2b5-4b6a-bf08-8a0452ee916b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735352a25ac147359725c96ca517fd3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:30Z,use_quota=True,user_id='840c31ed8f904fbbb0a098727c3fbabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Creating volume aad9c152-e2b5-4b6a-bf08-8a0452ee916b {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:45:30 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:30 devstack quobyte-client[82822]: System call of process 94581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:45:30 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=69, name=volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b 1073741824" returned: 0 in 0.516s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b" returned: 0 in 0.228s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] <== create_volume: return (930ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdc5158-61ca-4827-b67a-0059626b86b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b444d721-22f5-4ca2-99f9-6ff9381fb3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:31 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Volume volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b (aad9c152-e2b5-4b6a-bf08-8a0452ee916b): created successfully
Sep 18 13:45:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b444d721-22f5-4ca2-99f9-6ff9381fb3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Flow 'volume_create_manager' (1e5eef7a-ce62-4c0e-ba8d-1c5f7c0eed36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:31 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8ce39a63-3588-45de-9a22-df0c8b4cd8ab tempest-VolumesTransfersV357Test-116465713 None] Created volume successfully.
Sep 18 13:45:33 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9b1c4920-bd5a-4ea4-b29d-545835f03fa6 tempest-VolumesTransfersV357Test-774406253 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:33 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9b1c4920-bd5a-4ea4-b29d-545835f03fa6 tempest-VolumesTransfersV357Test-774406253 None] Transfer volume completed successfully.
Sep 18 13:45:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Acquiring lock "cinder-aad9c152-e2b5-4b6a-bf08-8a0452ee916b-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Lock "cinder-aad9c152-e2b5-4b6a-bf08-8a0452ee916b-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:37 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Acquiring lock "cinder-quobyte-aad9c152-e2b5-4b6a-bf08-8a0452ee916b" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Lock "cinder-quobyte-aad9c152-e2b5-4b6a-bf08-8a0452ee916b" acquired by "delete_volume" :: waited 0.036s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:37 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c0a044-beba-4685-8cbb-cfeed2e5dac9]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:45:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b" returned: 0 in 0.995s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-aad9c152-e2b5-4b6a-bf08-8a0452ee916b" returned: 0 in 0.240s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Lock "cinder-quobyte-aad9c152-e2b5-4b6a-bf08-8a0452ee916b" released by "delete_volume" :: held 1.856s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:40 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Created reservations ['a5acb69a-acc1-45e6-bcf8-585f3d10ab7d', '4cde3568-3661-4a10-b854-9d9a350d5972', '3ff551ab-e7e8-462d-b15c-e9dc6948c123', '3e98e887-704d-44f1-aee4-3409f5641cf9'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:45:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.155s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:41 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:45:41 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Deleted volume successfully.
Sep 18 13:45:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-aa2ede89-b585-4b19-b363-3002f9c9d14c tempest-VolumesTransfersV357Test-1719875104 None] Lock "cinder-aad9c152-e2b5-4b6a-bf08-8a0452ee916b-delete_volume" released by "delete_volume" :: held 4.638s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:43 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Flow 'volume_create_manager' (e8bc3afb-bf2a-4e4a-87a9-3ca891dfc275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f6f8fe-da0c-4669-96ba-194916cc86a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f6f8fe-da0c-4669-96ba-194916cc86a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1579968474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6740411-0228-4fff-851b-1b65f53b5b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735352a25ac147359725c96ca517fd3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:43Z,use_quota=True,user_id='840c31ed8f904fbbb0a098727c3fbabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a034c231-c0cd-4911-a89a-cace6e71db5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a034c231-c0cd-4911-a89a-cace6e71db5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd21a82-eb7b-4367-ba49-f64beb078d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd21a82-eb7b-4367-ba49-f64beb078d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6740411-0228-4fff-851b-1b65f53b5b3e', 'volume_name': 'volume-f6740411-0228-4fff-851b-1b65f53b5b3e', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e09e700-0e99-4f9d-955a-85a378cf9ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e09e700-0e99-4f9d-955a-85a378cf9ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cec084-f4ed-428f-a23b-943f27e7e293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:43 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Volume f6740411-0228-4fff-851b-1b65f53b5b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6740411-0228-4fff-851b-1b65f53b5b3e', 'volume_size': 1}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1579968474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6740411-0228-4fff-851b-1b65f53b5b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735352a25ac147359725c96ca517fd3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:43Z,use_quota=True,user_id='840c31ed8f904fbbb0a098727c3fbabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Creating volume f6740411-0228-4fff-851b-1b65f53b5b3e {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:45:43 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:45:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f6740411-0228-4fff-851b-1b65f53b5b3e 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:43 devstack quobyte-client[82822]: System call of process 94736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:45:43 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=70, name=volume-f6740411-0228-4fff-851b-1b65f53b5b3e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:45:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f6740411-0228-4fff-851b-1b65f53b5b3e 1073741824" returned: 0 in 0.684s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f6740411-0228-4fff-851b-1b65f53b5b3e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f6740411-0228-4fff-851b-1b65f53b5b3e" returned: 0 in 0.139s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:44 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] <== create_volume: return (919ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cec084-f4ed-428f-a23b-943f27e7e293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6740411-0228-4fff-851b-1b65f53b5b3e', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4bc4b7-8bb5-47f8-a1f8-1e013f6ecba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:45 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Volume volume-f6740411-0228-4fff-851b-1b65f53b5b3e (f6740411-0228-4fff-851b-1b65f53b5b3e): created successfully
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4bc4b7-8bb5-47f8-a1f8-1e013f6ecba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Flow 'volume_create_manager' (e8bc3afb-bf2a-4e4a-87a9-3ca891dfc275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:45 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (e02d012c-2f4a-4499-b00a-ea69539d94bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c173cf56-2c15-460a-b999-73fd6ccadf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:45 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-2f4f2097-ce9e-42ff-a0c8-1bff0274fbad tempest-VolumesTransfersV357Test-116465713 None] Created volume successfully.
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c173cf56-2c15-460a-b999-73fd6ccadf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1586098623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2392237-e322-4eba-a5e7-ddc0fe2b94b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:44Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1619f2-be11-4f8f-86ff-fb693bbfdab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1619f2-be11-4f8f-86ff-fb693bbfdab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5f4043-ea75-4ec9-b444-0fe331c82ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5f4043-ea75-4ec9-b444-0fe331c82ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2392237-e322-4eba-a5e7-ddc0fe2b94b7', 'volume_name': 'volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c2a5e9-6850-4258-8358-0a729d0ccd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c2a5e9-6850-4258-8358-0a729d0ccd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d23cadc-91b8-42d5-b603-fdddc53e0ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:45 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Volume c2392237-e322-4eba-a5e7-ddc0fe2b94b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7', 'volume_size': 1}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1586098623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2392237-e322-4eba-a5e7-ddc0fe2b94b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:44Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Creating volume c2392237-e322-4eba-a5e7-ddc0fe2b94b7 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:45:45 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:45:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:46 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=71, name=volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:45:46 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:46 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:45:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (67dc76d4-0da6-4d8b-a0ae-77b4901ac1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42c00a6-8624-4556-8576-36053b335ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:46 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Acquiring lock "cinder-f6740411-0228-4fff-851b-1b65f53b5b3e-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7 1073741824" returned: 0 in 1.539s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42c00a6-8624-4556-8576-36053b335ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229745556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efb299f-0d8d-494c-94ba-6314a79b9b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:45Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9dc4bd-3455-46ba-bc94-55be2aa27621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9dc4bd-3455-46ba-bc94-55be2aa27621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3a427c-e1d3-469c-85ad-10d78c4c7fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3a427c-e1d3-469c-85ad-10d78c4c7fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8efb299f-0d8d-494c-94ba-6314a79b9b68', 'volume_name': 'volume-8efb299f-0d8d-494c-94ba-6314a79b9b68', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a42917-f834-40f5-8093-e464fe0f6b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a42917-f834-40f5-8093-e464fe0f6b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ad5262-a219-4e32-aedd-8da92623714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Volume 8efb299f-0d8d-494c-94ba-6314a79b9b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8efb299f-0d8d-494c-94ba-6314a79b9b68', 'volume_size': 1}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (264acb78-56ab-47e5-8f44-c4dc24b3b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bcbc9e-2746-417e-b04d-e9d72928e9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Lock "cinder-f6740411-0228-4fff-851b-1b65f53b5b3e-delete_volume" acquired by "delete_volume" :: waited 1.004s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bcbc9e-2746-417e-b04d-e9d72928e9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989315094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da61e23b-a77a-4714-a817-ecd3c714dd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:47Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cfaa1f-c1ca-4a0f-9a07-be187daade84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cfaa1f-c1ca-4a0f-9a07-be187daade84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2e1b0b-373d-49bc-a973-57a01a1704fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2e1b0b-373d-49bc-a973-57a01a1704fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da61e23b-a77a-4714-a817-ecd3c714dd6c', 'volume_name': 'volume-da61e23b-a77a-4714-a817-ecd3c714dd6c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d9265e-b62f-4208-bb8a-530c22817c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d9265e-b62f-4208-bb8a-530c22817c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a4e2ca-7a5f-45bd-b36b-1d9aff5cfdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Volume da61e23b-a77a-4714-a817-ecd3c714dd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da61e23b-a77a-4714-a817-ecd3c714dd6c', 'volume_size': 1}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (2d5471d1-e8ba-44ba-bb87-2d4f56a6c4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466061ab-74ce-42f4-a55d-1053e3397058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7" returned: 0 in 0.947s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] <== create_volume: return (2541ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.549s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229745556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efb299f-0d8d-494c-94ba-6314a79b9b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:45Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Creating volume 8efb299f-0d8d-494c-94ba-6314a79b9b68 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:45:48 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8efb299f-0d8d-494c-94ba-6314a79b9b68 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:48 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=72, name=volume-8efb299f-0d8d-494c-94ba-6314a79b9b68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d23cadc-91b8-42d5-b603-fdddc53e0ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5eea0b3-7901-4138-af6e-5abc1b6fd7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466061ab-74ce-42f4-a55d-1053e3397058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762047594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f535cbb1-36f0-49ee-9917-ead5034313ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:46Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b10411-644e-409e-af74-1b7c8eec6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b10411-644e-409e-af74-1b7c8eec6992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c998ef32-723d-4f6d-afda-07cea2d5ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c998ef32-723d-4f6d-afda-07cea2d5ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f535cbb1-36f0-49ee-9917-ead5034313ef', 'volume_name': 'volume-f535cbb1-36f0-49ee-9917-ead5034313ef', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f75a5bf-0fcd-474b-9791-3e3c96038a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f75a5bf-0fcd-474b-9791-3e3c96038a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a06d2bc-dbf3-4c07-b9eb-b209f93d5ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:48 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Volume f535cbb1-36f0-49ee-9917-ead5034313ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f535cbb1-36f0-49ee-9917-ead5034313ef', 'volume_size': 1}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:48 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (fce91a5e-2e16-4d29-8e9e-7e92dac4b071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc120808-3e8d-4f1c-8dae-49eda72abd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:48 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Volume volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7 (c2392237-e322-4eba-a5e7-ddc0fe2b94b7): created successfully
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5eea0b3-7901-4138-af6e-5abc1b6fd7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (e02d012c-2f4a-4499-b00a-ea69539d94bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:48 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Acquiring lock "cinder-quobyte-f6740411-0228-4fff-851b-1b65f53b5b3e" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-5bfd8bd2-7164-4b63-bf72-792694355f05 tempest-CreateVolumesFromImageTest-1744173979 None] Created volume successfully.
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8efb299f-0d8d-494c-94ba-6314a79b9b68 1073741824" returned: 0 in 0.978s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc120808-3e8d-4f1c-8dae-49eda72abd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1986596053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07012ee8-b54b-4a3a-93cb-d4c732bf3b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:47Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6af30c-d3fb-4319-a6d5-62d9913f3331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6af30c-d3fb-4319-a6d5-62d9913f3331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a805fab7-fefa-493e-95cb-6d473950f6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a805fab7-fefa-493e-95cb-6d473950f6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07012ee8-b54b-4a3a-93cb-d4c732bf3b3c', 'volume_name': 'volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712b657f-fc29-434f-b55e-84f23d9453ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712b657f-fc29-434f-b55e-84f23d9453ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc4ebef-c484-4fe6-8d4d-83992a0e347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:49 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Volume 07012ee8-b54b-4a3a-93cb-d4c732bf3b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c', 'volume_size': 1}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8efb299f-0d8d-494c-94ba-6314a79b9b68 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Lock "cinder-quobyte-f6740411-0228-4fff-851b-1b65f53b5b3e" acquired by "delete_volume" :: waited 1.648s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8efb299f-0d8d-494c-94ba-6314a79b9b68" returned: 0 in 1.518s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] <== create_volume: return (2752ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.775s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[581d1f98-9de3-42b7-b8be-b2fc107c767f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.031s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989315094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da61e23b-a77a-4714-a817-ecd3c714dd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:47Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Creating volume da61e23b-a77a-4714-a817-ecd3c714dd6c {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:45:50 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:45:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-da61e23b-a77a-4714-a817-ecd3c714dd6c 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f6740411-0228-4fff-851b-1b65f53b5b3e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:51 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=73, name=volume-da61e23b-a77a-4714-a817-ecd3c714dd6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:45:51 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ad5262-a219-4e32-aedd-8da92623714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efb299f-0d8d-494c-94ba-6314a79b9b68', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:52 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d0b04e-bfdd-4986-a8e6-cacfac4eb475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-da61e23b-a77a-4714-a817-ecd3c714dd6c 1073741824" returned: 0 in 1.234s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-da61e23b-a77a-4714-a817-ecd3c714dd6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:52 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Volume volume-8efb299f-0d8d-494c-94ba-6314a79b9b68 (8efb299f-0d8d-494c-94ba-6314a79b9b68): created successfully
Sep 18 13:45:52 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d0b04e-bfdd-4986-a8e6-cacfac4eb475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:52 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (67dc76d4-0da6-4d8b-a0ae-77b4901ac1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-da61e23b-a77a-4714-a817-ecd3c714dd6c" returned: 0 in 0.846s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] <== create_volume: return (2105ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.452s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762047594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f535cbb1-36f0-49ee-9917-ead5034313ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:46Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Creating volume f535cbb1-36f0-49ee-9917-ead5034313ef {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:45:53 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f535cbb1-36f0-49ee-9917-ead5034313ef 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:53 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=74, name=volume-f535cbb1-36f0-49ee-9917-ead5034313ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:45:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8d2855fc-99b0-448a-b6b7-8f107e166572 tempest-CreateVolumesFromImageTest-1744173979 None] Created volume successfully.
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f6740411-0228-4fff-851b-1b65f53b5b3e" returned: 0 in 2.508s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f6740411-0228-4fff-851b-1b65f53b5b3e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a4e2ca-7a5f-45bd-b36b-1d9aff5cfdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da61e23b-a77a-4714-a817-ecd3c714dd6c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cd3af7-447e-418a-9cf7-5838a275c20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f6740411-0228-4fff-851b-1b65f53b5b3e" returned: 0 in 0.908s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f535cbb1-36f0-49ee-9917-ead5034313ef 1073741824" returned: 0 in 1.523s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f535cbb1-36f0-49ee-9917-ead5034313ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:54 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Volume volume-da61e23b-a77a-4714-a817-ecd3c714dd6c (da61e23b-a77a-4714-a817-ecd3c714dd6c): created successfully
Sep 18 13:45:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cd3af7-447e-418a-9cf7-5838a275c20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (264acb78-56ab-47e5-8f44-c4dc24b3b437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Lock "cinder-quobyte-f6740411-0228-4fff-851b-1b65f53b5b3e" released by "delete_volume" :: held 4.492s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f535cbb1-36f0-49ee-9917-ead5034313ef" returned: 0 in 0.487s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:55 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bd4ee3f3-a4d3-43f0-941b-e64f91e43f3d tempest-CreateVolumesFromImageTest-1744173979 None] Created volume successfully.
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] <== create_volume: return (2069ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.981s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1986596053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07012ee8-b54b-4a3a-93cb-d4c732bf3b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa434a3a04bfbaf03a04ff6206430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:45:47Z,use_quota=True,user_id='e273250f5e444006a2c04bfdbcbc10f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Creating volume 07012ee8-b54b-4a3a-93cb-d4c732bf3b3c {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:45:55 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:55 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=75, name=volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a06d2bc-dbf3-4c07-b9eb-b209f93d5ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f535cbb1-36f0-49ee-9917-ead5034313ef', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f34a78-7e0e-4797-82f3-c9116601c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c 1073741824" returned: 0 in 0.645s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Created reservations ['5f054fda-a7d9-45e9-a85c-2203742599ee', '1e69f731-d601-4fe3-8458-10e8cb58e070', 'ca8f1a24-3862-4788-b31f-77cd28ac3843', 'f8114926-338b-4d83-8e86-73154728d7b9'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:45:56 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Volume volume-f535cbb1-36f0-49ee-9917-ead5034313ef (f535cbb1-36f0-49ee-9917-ead5034313ef): created successfully
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f34a78-7e0e-4797-82f3-c9116601c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (2d5471d1-e8ba-44ba-bb87-2d4f56a6c4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c" returned: 0 in 0.425s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] <== create_volume: return (1098ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:56 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0d3a6519-1198-42d8-8d18-d5ee5cd70669 tempest-CreateVolumesFromImageTest-1744173979 None] Created volume successfully.
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc4ebef-c484-4fe6-8d4d-83992a0e347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e631a1e7-cbe3-46a1-a57c-165ccab4c9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:45:56 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Volume volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c (07012ee8-b54b-4a3a-93cb-d4c732bf3b3c): created successfully
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e631a1e7-cbe3-46a1-a57c-165ccab4c9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Flow 'volume_create_manager' (fce91a5e-2e16-4d29-8e9e-7e92dac4b071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:45:56 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3c521dc8-f605-4469-8760-8aaba71ee936 tempest-CreateVolumesFromImageTest-1744173979 None] Created volume successfully.
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.365s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:57 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:45:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:57 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Deleted volume successfully.
Sep 18 13:45:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b863d966-8db3-401b-bbd2-5cad6990082b tempest-VolumesTransfersV357Test-1719875104 None] Lock "cinder-f6740411-0228-4fff-851b-1b65f53b5b3e-delete_volume" released by "delete_volume" :: held 9.528s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:45:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-quobyte-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c" acquired by "delete_volume" :: waited 0.027s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:45:57 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ccb4a8-500f-4c71-b431-917b8b7e338f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:45:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:58 devstack quobyte-client[82822]: System call of process 95167 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:45:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c" returned: 0 in 0.886s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c" returned: 0 in 0.168s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:58 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c" released by "delete_volume" :: held 1.334s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Created reservations ['9753bc18-2135-4dec-bbf6-b8d821e2b5e4', '9b24f87c-af36-4020-9e88-e8d81710d06c', '9c4c5ee5-1ac8-4cea-b82c-fce6344ad4d1', '98c6914f-08ac-42c1-958d-2f71e423555e'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-da61e23b-a77a-4714-a817-ecd3c714dd6c-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.574s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:45:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-da61e23b-a77a-4714-a817-ecd3c714dd6c-delete_volume" acquired by "delete_volume" :: waited 0.216s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:00 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:00 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Deleted volume successfully.
Sep 18 13:46:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-02f010c5-3fd2-4918-8f54-9675ac1dab65 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-07012ee8-b54b-4a3a-93cb-d4c732bf3b3c-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-quobyte-da61e23b-a77a-4714-a817-ecd3c714dd6c" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-da61e23b-a77a-4714-a817-ecd3c714dd6c" acquired by "delete_volume" :: waited 0.027s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:00 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74c4a0f-0e56-4210-a363-49d3a799c0b8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-da61e23b-a77a-4714-a817-ecd3c714dd6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-da61e23b-a77a-4714-a817-ecd3c714dd6c" returned: 0 in 0.740s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-da61e23b-a77a-4714-a817-ecd3c714dd6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-da61e23b-a77a-4714-a817-ecd3c714dd6c" returned: 0 in 0.117s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-da61e23b-a77a-4714-a817-ecd3c714dd6c" released by "delete_volume" :: held 1.055s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:01 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Created reservations ['791efcbd-825a-4efe-8243-5c7a419f331e', 'eca1ae06-d159-4898-9def-1b55712524df', 'c35b83f5-7c99-4f02-a42b-0a3958af943e', '552bcb5b-c946-402f-8197-dcf8b37b5d7e'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.125s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:02 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:02 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Deleted volume successfully.
Sep 18 13:46:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-663cd9b7-c49d-4f81-93f0-b2aea8623f4f tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-da61e23b-a77a-4714-a817-ecd3c714dd6c-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-f535cbb1-36f0-49ee-9917-ead5034313ef-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-f535cbb1-36f0-49ee-9917-ead5034313ef-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:03 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-quobyte-f535cbb1-36f0-49ee-9917-ead5034313ef" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-f535cbb1-36f0-49ee-9917-ead5034313ef" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:03 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da040d2-de33-4bb5-bb73-8dd85528d698]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f535cbb1-36f0-49ee-9917-ead5034313ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f535cbb1-36f0-49ee-9917-ead5034313ef" returned: 0 in 0.606s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f535cbb1-36f0-49ee-9917-ead5034313ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f535cbb1-36f0-49ee-9917-ead5034313ef" returned: 0 in 0.161s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-f535cbb1-36f0-49ee-9917-ead5034313ef" released by "delete_volume" :: held 1.100s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Created reservations ['dc1280a2-1c91-4ce5-96ca-412e86ac5094', 'c65a68cd-2e34-4eb9-93fd-7f3e0789f65f', '5c8273bb-25c0-4255-b2fc-e036c1e5277f', '8e209d83-717e-47af-b2d9-1c58c0a8ee3c'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.157s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:05 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:05 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Deleted volume successfully.
Sep 18 13:46:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-83c50a35-4880-4f8f-939c-ee67b90b8c58 tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-f535cbb1-36f0-49ee-9917-ead5034313ef-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-8efb299f-0d8d-494c-94ba-6314a79b9b68-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-8efb299f-0d8d-494c-94ba-6314a79b9b68-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-quobyte-8efb299f-0d8d-494c-94ba-6314a79b9b68" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-8efb299f-0d8d-494c-94ba-6314a79b9b68" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:05 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddee79a0-b7d5-4c2a-9d5c-d9857d6e684c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8efb299f-0d8d-494c-94ba-6314a79b9b68 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8efb299f-0d8d-494c-94ba-6314a79b9b68" returned: 0 in 0.639s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8efb299f-0d8d-494c-94ba-6314a79b9b68 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8efb299f-0d8d-494c-94ba-6314a79b9b68" returned: 0 in 0.150s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:06 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-8efb299f-0d8d-494c-94ba-6314a79b9b68" released by "delete_volume" :: held 0.993s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:07 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Created reservations ['5c1c3e7d-0e67-419e-9875-b8839df3aec1', '3e30fd95-afb1-4715-9925-69951fb091d8', 'c84aefc6-e138-4096-bb31-7f6b7fe67b6f', '5f14b6fc-02e9-4b40-befe-90384541a5cb'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.190s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:08 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-c2392237-e322-4eba-a5e7-ddc0fe2b94b7-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:08 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Deleted volume successfully.
Sep 18 13:46:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-c2392237-e322-4eba-a5e7-ddc0fe2b94b7-delete_volume" acquired by "delete_volume" :: waited 0.174s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-31300e71-9ef0-40e6-848b-f5ed22513c1d tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-8efb299f-0d8d-494c-94ba-6314a79b9b68-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:08 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "cinder-quobyte-c2392237-e322-4eba-a5e7-ddc0fe2b94b7" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-c2392237-e322-4eba-a5e7-ddc0fe2b94b7" acquired by "delete_volume" :: waited 0.028s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:08 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f00936c-3dd2-4325-b72b-95f2a7ea717b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7" returned: 0 in 0.690s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c2392237-e322-4eba-a5e7-ddc0fe2b94b7" returned: 0 in 0.426s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:09 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:46:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Flow 'volume_create_manager' (37aeceff-6868-4146-9910-f28f88083a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:46:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd953b1-faed-4d69-a840-33e48f4c229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-quobyte-c2392237-e322-4eba-a5e7-ddc0fe2b94b7" released by "delete_volume" :: held 1.541s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd953b1-faed-4d69-a840-33e48f4c229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1052271860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b536d0-9047-4dfb-ab26-91940aee113d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e914db7d66f450f87b1e296671e5619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:46:09Z,use_quota=True,user_id='23b1b9184d904bac880d8d4ffa1669be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0f35fe-c474-4af7-8701-3628e7495cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0f35fe-c474-4af7-8701-3628e7495cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45542ef-d871-4931-8763-cf639ab5a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.image.glance [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Creating Keystone auth plugin from conf {{(pid=82799) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Created reservations ['b434099a-1a4c-4b1b-a102-81ca8e68ed07', 'c1aa834b-a7e8-4a6e-a89c-55408c52f6a1', 'c6c9b0da-3df7-400d-80d1-cd9f70d08cab', '05ecdf55-f16a-4b5d-a672-1cd764759cb4'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.246s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:10 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Deleted volume successfully.
Sep 18 13:46:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45542ef-d871-4931-8763-cf639ab5a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0b536d0-9047-4dfb-ab26-91940aee113d', 'volume_name': 'volume-a0b536d0-9047-4dfb-ab26-91940aee113d', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c262cb0>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb1a4e2-f203-4934-b2e9-da4351b3ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb1a4e2-f203-4934-b2e9-da4351b3ee86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd09f7d3-65c5-4279-ae66-de9d0b046d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Volume a0b536d0-9047-4dfb-ab26-91940aee113d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0b536d0-9047-4dfb-ab26-91940aee113d', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c262cb0>}
Sep 18 13:46:11 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Cloning a0b536d0-9047-4dfb-ab26-91940aee113d from image bcfddd9f-68c0-4f36-86c6-1809e131a4ca  at location (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]). {{(pid=82799) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 13:46:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1419fa04-a28f-47e0-8103-4e726478700c tempest-CreateVolumesFromImageTest-1744173979 None] Lock "cinder-c2392237-e322-4eba-a5e7-ddc0fe2b94b7-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:11 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 13:46:11 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 13:46:11 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b674fa-249e-44f3-a1d2-a26e9ab62d28]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:12 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD
Sep 18 13:46:12 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:46:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:46:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.245s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:15 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Sep 18 13:46:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD" returned: 0 in 3.381s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:15 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Temporary image bcfddd9f-68c0-4f36-86c6-1809e131a4ca is fetched for user 23b1b9184d904bac880d8d4ffa1669be. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 13:46:15 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfedcea-636a-41fd-82f9-dba814d5b23e]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:16 devstack sudo[95233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD
Sep 18 13:46:16 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:46:18 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:46:18 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Flow 'volume_create_manager' (e723fc50-f7cf-4f55-9ec8-705642b52caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073a8bc4-0117-48e5-9d07-c04d204b26ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073a8bc4-0117-48e5-9d07-c04d204b26ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7647a4af-03a8-42f8-a203-c4d4186b3e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d80966edc68465e965c1ebe7e5a45d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:46:18Z,use_quota=True,user_id='a45127ce243c42beb16a1665d58190a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28db62a7-abab-48ca-9e14-3dbd872b9999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28db62a7-abab-48ca-9e14-3dbd872b9999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5a74f9-77f8-4325-8d8a-76411661449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5a74f9-77f8-4325-8d8a-76411661449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7647a4af-03a8-42f8-a203-c4d4186b3e62', 'volume_name': 'volume-7647a4af-03a8-42f8-a203-c4d4186b3e62', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef47ef-91e6-4302-8cc1-94adcf5120f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef47ef-91e6-4302-8cc1-94adcf5120f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbe0b2a-016a-462e-84e5-7ddfb5b2ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:18 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Volume 7647a4af-03a8-42f8-a203-c4d4186b3e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7647a4af-03a8-42f8-a203-c4d4186b3e62', 'volume_size': 1}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7647a4af-03a8-42f8-a203-c4d4186b3e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d80966edc68465e965c1ebe7e5a45d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:46:18Z,use_quota=True,user_id='a45127ce243c42beb16a1665d58190a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Creating volume 7647a4af-03a8-42f8-a203-c4d4186b3e62 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:46:18 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7647a4af-03a8-42f8-a203-c4d4186b3e62 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD" returned: 0 in 3.142s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:18 devstack quobyte-client[82822]: System call of process 95238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:18 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=76, name=volume-7647a4af-03a8-42f8-a203-c4d4186b3e62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7647a4af-03a8-42f8-a203-c4d4186b3e62 1073741824" returned: 0 in 0.550s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7647a4af-03a8-42f8-a203-c4d4186b3e62 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7647a4af-03a8-42f8-a203-c4d4186b3e62" returned: 0 in 0.115s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] <== create_volume: return (724ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1052271860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b536d0-9047-4dfb-ab26-91940aee113d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e914db7d66f450f87b1e296671e5619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:46:09Z,use_quota=True,user_id='23b1b9184d904bac880d8d4ffa1669be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Creating volume a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:46:19 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:19 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=77, name=volume-a0b536d0-9047-4dfb-ab26-91940aee113d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbe0b2a-016a-462e-84e5-7ddfb5b2ad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7647a4af-03a8-42f8-a203-c4d4186b3e62', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c8e65e-c9a5-447d-b030-945bc2ae61af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:19 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Volume volume-7647a4af-03a8-42f8-a203-c4d4186b3e62 (7647a4af-03a8-42f8-a203-c4d4186b3e62): created successfully
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c8e65e-c9a5-447d-b030-945bc2ae61af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Flow 'volume_create_manager' (e723fc50-f7cf-4f55-9ec8-705642b52caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d 1073741824" returned: 0 in 0.512s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:20 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-df915e8d-94b1-4419-9390-e4eb44353eaa tempest-CinderUnicodeTest-698478748 None] Created volume successfully.
Sep 18 13:46:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d" returned: 0 in 0.237s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] <== create_volume: return (779ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:46:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:20 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Attempting download of bcfddd9f-68c0-4f36-86c6-1809e131a4ca ((None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}])) to volume a0b536d0-9047-4dfb-ab26-91940aee113d. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 13:46:20 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5a8d49-3972-4714-a492-ffc3b16cf383]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__9gljei6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__9gljei6" returned: 0 in 1.066s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__9gljei6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:21 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Flow 'volume_create_manager' (dd6fc5d6-bc69-4e2d-9f18-c830f504eaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0915177a-4424-407c-a57c-6d8a90e75afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0915177a-4424-407c-a57c-6d8a90e75afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:46:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1384262119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d552d710-bf4e-43e7-8ea0-a62bbdc904d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d80966edc68465e965c1ebe7e5a45d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:46:21Z,use_quota=True,user_id='a45127ce243c42beb16a1665d58190a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981edef0-b10c-4362-a7c8-973dd7880fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981edef0-b10c-4362-a7c8-973dd7880fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddecb30-4041-481e-898f-4745756cd080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddecb30-4041-481e-898f-4745756cd080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd552d710-bf4e-43e7-8ea0-a62bbdc904d4', 'volume_name': 'volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d49d367-427c-4707-b55e-2718844eb55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d49d367-427c-4707-b55e-2718844eb55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a19b6d-dfde-4114-97e7-efee5d7ef536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:22 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Volume d552d710-bf4e-43e7-8ea0-a62bbdc904d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4', 'volume_size': 1}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:46:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1384262119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d552d710-bf4e-43e7-8ea0-a62bbdc904d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d80966edc68465e965c1ebe7e5a45d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:46:21Z,use_quota=True,user_id='a45127ce243c42beb16a1665d58190a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Creating volume d552d710-bf4e-43e7-8ea0-a62bbdc904d4 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:46:22 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__9gljei6" returned: 1 in 0.950s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca__9gljei6' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[545a88f8-c1ca-4122-b5b7-d005f5eeaa02]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:22 devstack quobyte-client[82822]: System call of process 95250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:22 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=78, name=volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 1073741824" returned: 0 in 0.753s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD" returned: 0 in 0.604s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] bcfddd9f-68c0-4f36-86c6-1809e131a4ca was qcow2, converting to raw {{(pid=82799) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" returned: 0 in 0.316s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] <== create_volume: return (1233ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:23 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=77, name=volume-a0b536d0-9047-4dfb-ab26-91940aee113d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a19b6d-dfde-4114-97e7-efee5d7ef536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46ad813-ac05-460a-af8a-362a18dd78bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:24 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Volume volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 (d552d710-bf4e-43e7-8ea0-a62bbdc904d4): created successfully
Sep 18 13:46:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46ad813-ac05-460a-af8a-362a18dd78bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Flow 'volume_create_manager' (dd6fc5d6-bc69-4e2d-9f18-c830f504eaf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:46:24 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-83370485-056d-4c6f-a365-27be712ace65 tempest-CinderUnicodeTest-698478748 None] Created volume successfully.
Sep 18 13:46:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d" returned: 0 in 1.297s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:24 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_05mwct25devstack@QuobyteHD, size 112.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:46:24 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Converted 112.00 MB image at 85.91 MB/s
Sep 18 13:46:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d 1G" returned: 0 in 0.238s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:25 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[21536c4c-3225-4cd6-b8d3-acbd8ab87b25]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:25 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Creating offline snapshot b3e432b1-41fd-4ff6-b742-740a1d016d82 of volume d552d710-bf4e-43e7-8ea0-a62bbdc904d4 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:46:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d" returned: 0 in 0.791s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:25 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a387c1-8ce9-4054-8144-f7dea49bf833]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" returned: 0 in 0.563s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:26 devstack quobyte-client[82822]: System call of process 95269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d" returned: 1 in 0.818s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:46:26 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Downloaded image bcfddd9f-68c0-4f36-86c6-1809e131a4ca ((None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}])) to volume a0b536d0-9047-4dfb-ab26-91940aee113d successfully. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 13:46:26 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Temporary image bcfddd9f-68c0-4f36-86c6-1809e131a4ca for user 23b1b9184d904bac880d8d4ffa1669be is deleted. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 13:46:26 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Marking volume a0b536d0-9047-4dfb-ab26-91940aee113d as bootable. {{(pid=82799) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 13:46:26 devstack quobyte-client[82822]: System call of process 95276 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:26 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=79, name=volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:46:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=99,cinder:SELECT=51,cinder:DELETE=10,cinder:INSERT=19 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Copying metadata from image bcfddd9f-68c0-4f36-86c6-1809e131a4ca to a0b536d0-9047-4dfb-ab26-91940aee113d. {{(pid=82799) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Creating volume glance metadata for volume a0b536d0-9047-4dfb-ab26-91940aee113d backed by image bcfddd9f-68c0-4f36-86c6-1809e131a4ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82799) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=45,cinder:UPDATE=54,cinder:DELETE=6,cinder:INSERT=10 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 1G" returned: 0 in 0.429s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:27 devstack quobyte-client[82822]: System call of process 95279 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:27 devstack quobyte-client[82822]: System call of process 95279 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] CMD "qemu-img rebase -u -b volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82" returned: 0 in 0.335s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82" returned: 0 in 0.337s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:46:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82" returned: 0 in 0.241s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.info" returned: 0 in 0.304s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.info" returned: 0 in 0.289s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:28 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-6cf45581-5b32-43ce-933d-53d17bf7be6e tempest-CinderUnicodeTest-698478748 None] Create snapshot completed successfully
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd09f7d3-65c5-4279-ae66-de9d0b046d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b536d0-9047-4dfb-ab26-91940aee113d', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c262cb0>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261966a5-e37d-4123-8f57-4f9067153f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:28 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Volume volume-a0b536d0-9047-4dfb-ab26-91940aee113d (a0b536d0-9047-4dfb-ab26-91940aee113d): created successfully
Sep 18 13:46:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261966a5-e37d-4123-8f57-4f9067153f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Flow 'volume_create_manager' (37aeceff-6868-4146-9910-f28f88083a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:46:29 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-cdae96bf-e840-4cd1-9305-6443afdd92de tempest-VolumesExtendTest-369352883 None] Created volume successfully.
Sep 18 13:46:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Acquiring lock "cinder-b3e432b1-41fd-4ff6-b742-740a1d016d82-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-b3e432b1-41fd-4ff6-b742-740a1d016d82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:30 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Acquiring lock "cinder-quobyte-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-quobyte-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Acquiring lock "cinder-quobyte-b3e432b1-41fd-4ff6-b742-740a1d016d82" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-quobyte-b3e432b1-41fd-4ff6-b742-740a1d016d82" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Deleting offline snapshot b3e432b1-41fd-4ff6-b742-740a1d016d82 of volume d552d710-bf4e-43e7-8ea0-a62bbdc904d4 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] snapshot_file for this snap is: volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5d7d23-2b21-47da-bae6-be879f7ff8d8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:30 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e000badc-d0c2-4746-99d9-72be344819b4]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82" returned: 0 in 0.759s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[40207a61-b11d-45c5-8d04-8f32f0b5f7b3]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d" returned: 0 in 0.831s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" returned: 0 in 0.695s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:31 devstack quobyte-client[82822]: System call of process 95312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82" returned: 0 in 0.321s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4.b3e432b1-41fd-4ff6-b742-740a1d016d82" returned: 0 in 0.154s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-quobyte-b3e432b1-41fd-4ff6-b742-740a1d016d82" released by "_delete_snapshot" :: held 2.343s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d" returned: 1 in 0.818s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:46:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-quobyte-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" released by "delete_snapshot" :: held 2.377s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d 2G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d 2G" returned: 0 in 0.413s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.409s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:33 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7ad94c50-bb1b-4d5f-9472-d471ebe48990 tempest-VolumesExtendTest-369352883 None] Extend volume completed successfully.
Sep 18 13:46:33 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Created reservations ['e9bfc956-ca35-42db-afe3-d27c952c43d6', 'ed046bce-a4c0-4298-9956-9d08e4b1906d', '6296556e-8d83-4cff-b19a-cf22ff8fa48e', '7160d803-6e1d-4aa2-8918-0f4044ce0cf1'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:33 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Delete snapshot completed successfully.
Sep 18 13:46:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7c98c61b-54d6-45a5-916d-c3733570eeb0 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-b3e432b1-41fd-4ff6-b742-740a1d016d82-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Acquiring lock "cinder-a0b536d0-9047-4dfb-ab26-91940aee113d-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Lock "cinder-a0b536d0-9047-4dfb-ab26-91940aee113d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Acquiring lock "cinder-d552d710-bf4e-43e7-8ea0-a62bbdc904d4-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Acquiring lock "cinder-quobyte-a0b536d0-9047-4dfb-ab26-91940aee113d" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Lock "cinder-d552d710-bf4e-43e7-8ea0-a62bbdc904d4-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Lock "cinder-quobyte-a0b536d0-9047-4dfb-ab26-91940aee113d" acquired by "delete_volume" :: waited 0.047s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Acquiring lock "cinder-quobyte-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Lock "cinder-quobyte-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e05b1be-5c3d-434e-a214-c73834d10a98]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0a1789-5af7-4f72-9699-a92dd766c598]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:35 devstack quobyte-client[82822]: System call of process 95328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d" returned: 0 in 0.786s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" returned: 0 in 1.247s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" returned: 0 in 0.146s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Lock "cinder-quobyte-d552d710-bf4e-43e7-8ea0-a62bbdc904d4" released by "delete_volume" :: held 2.037s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d" returned: 1 in 1.640s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a0b536d0-9047-4dfb-ab26-91940aee113d" returned: 0 in 0.265s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Lock "cinder-quobyte-a0b536d0-9047-4dfb-ab26-91940aee113d" released by "delete_volume" :: held 3.095s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Created reservations ['993714c1-036d-4a02-8d78-c7a30916e502', 'ec636fd3-33ed-424e-aa20-037a6252ed0e', 'e4d81ab9-4113-4b10-a6f5-bfdde3442479', 'e65c8457-1685-40a2-a113-03183f60cac2'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Created reservations ['54c4fbb9-7427-4270-93dd-4472e6c16c47', '4a713e30-a5ed-454f-b92d-61a14fccc16b', 'b56cfbfc-8863-4e69-bbd7-7a27232fe956', '9ae0ee15-f970-4570-9cac-7250a2fb50e3'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Acquiring lock "cinder-7647a4af-03a8-42f8-a203-c4d4186b3e62-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 1.200s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-7647a4af-03a8-42f8-a203-c4d4186b3e62-delete_volume" acquired by "delete_volume" :: waited 0.556s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.604s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:39 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Deleted volume successfully.
Sep 18 13:46:39 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Deleted volume successfully.
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-93f23c8c-115f-4e31-a6d3-6bbaf2cf514d tempest-CinderUnicodeTest-698478748 None] Lock "cinder-d552d710-bf4e-43e7-8ea0-a62bbdc904d4-delete_volume" released by "delete_volume" :: held 5.005s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:39 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Acquiring lock "cinder-quobyte-7647a4af-03a8-42f8-a203-c4d4186b3e62" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-baf24265-3430-4fc0-a1be-4e1fadbd5c19 tempest-VolumesExtendTest-369352883 None] Lock "cinder-a0b536d0-9047-4dfb-ab26-91940aee113d-delete_volume" released by "delete_volume" :: held 5.489s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-quobyte-7647a4af-03a8-42f8-a203-c4d4186b3e62" acquired by "delete_volume" :: waited 0.104s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a81465d-734e-48b8-a28c-3b6d76c0e093]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7647a4af-03a8-42f8-a203-c4d4186b3e62 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:40 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Flow 'volume_create_manager' (4259d0c4-fe02-4fd1-9095-9130ff9bc7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a626c5-cadf-4a6f-b4de-68cb9753323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:40 devstack quobyte-client[82822]: System call of process 95345 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a626c5-cadf-4a6f-b4de-68cb9753323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1241700247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647063b6-9193-4501-9f90-224f2c8d79ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e914db7d66f450f87b1e296671e5619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:46:40Z,use_quota=True,user_id='23b1b9184d904bac880d8d4ffa1669be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d947d4a-7c47-4049-9dab-86f40c2cea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d947d4a-7c47-4049-9dab-86f40c2cea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886b7c02-2faf-4316-bf6a-ba6b237887a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886b7c02-2faf-4316-bf6a-ba6b237887a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647063b6-9193-4501-9f90-224f2c8d79ef', 'volume_name': 'volume-647063b6-9193-4501-9f90-224f2c8d79ef', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e90e958-0fb2-4029-bb81-60c519e1bd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e90e958-0fb2-4029-bb81-60c519e1bd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72daee8-64f0-4f70-bf63-3b7287c837c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:40 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Volume 647063b6-9193-4501-9f90-224f2c8d79ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647063b6-9193-4501-9f90-224f2c8d79ef', 'volume_size': 1}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1241700247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647063b6-9193-4501-9f90-224f2c8d79ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e914db7d66f450f87b1e296671e5619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:46:40Z,use_quota=True,user_id='23b1b9184d904bac880d8d4ffa1669be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Creating volume 647063b6-9193-4501-9f90-224f2c8d79ef {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:46:40 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:46:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7647a4af-03a8-42f8-a203-c4d4186b3e62" returned: 0 in 1.146s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7647a4af-03a8-42f8-a203-c4d4186b3e62 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:41 devstack quobyte-client[82822]: System call of process 95358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:41 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=81, name=volume-647063b6-9193-4501-9f90-224f2c8d79ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:46:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7647a4af-03a8-42f8-a203-c4d4186b3e62" returned: 0 in 0.259s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-quobyte-7647a4af-03a8-42f8-a203-c4d4186b3e62" released by "delete_volume" :: held 1.745s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef 1073741824" returned: 0 in 1.244s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef" returned: 0 in 0.422s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] <== create_volume: return (1745ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72daee8-64f0-4f70-bf63-3b7287c837c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647063b6-9193-4501-9f90-224f2c8d79ef', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1db0a1-2ad5-4e30-9b42-8757c1f5e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:46:42 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Volume volume-647063b6-9193-4501-9f90-224f2c8d79ef (647063b6-9193-4501-9f90-224f2c8d79ef): created successfully
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1db0a1-2ad5-4e30-9b42-8757c1f5e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Flow 'volume_create_manager' (4259d0c4-fe02-4fd1-9095-9130ff9bc7e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Created reservations ['9cb62001-c32a-4a10-87ed-9a612ea538b9', 'a5f8893c-cddd-4b1d-80bc-0407c43dbd9a', '7edef5c4-df9a-49b0-938f-e65ccb1fda90', '6ddb0822-b37d-451f-b7a3-deabbf272316'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4a409a57-ad99-48a0-b5be-364f48a3ee53 tempest-VolumesExtendTest-369352883 None] Created volume successfully.
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.189s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:43 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:43 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Deleted volume successfully.
Sep 18 13:46:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-adab2654-e55c-4e46-83e4-e1c64f4a4142 tempest-CinderUnicodeTest-698478748 None] Lock "cinder-7647a4af-03a8-42f8-a203-c4d4186b3e62-delete_volume" released by "delete_volume" :: held 4.273s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:44 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:44 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Creating offline snapshot a17eeae9-e26a-4285-acd3-93bbc7fefdbe of volume 647063b6-9193-4501-9f90-224f2c8d79ef {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:46:44 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d4793b-84a8-4096-bb9b-f5986ca5a43f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef" returned: 0 in 0.528s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:45 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=82, name=volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe 1G" returned: 0 in 0.298s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): qemu-img rebase -u -b volume-647063b6-9193-4501-9f90-224f2c8d79ef -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] CMD "qemu-img rebase -u -b volume-647063b6-9193-4501-9f90-224f2c8d79ef -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe" returned: 0 in 0.178s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe" returned: 0 in 0.112s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe" returned: 0 in 0.109s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.info" returned: 0 in 0.151s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:46:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.info" returned: 0 in 0.108s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:46 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-cdb08676-12f5-4ae1-b32a-f190f85760b0 tempest-VolumesExtendTest-369352883 None] Create snapshot completed successfully
Sep 18 13:46:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b29e605e-52dd-4c4a-8a9c-eff1a9706087 tempest-VolumesExtendTest-369352883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b29e605e-52dd-4c4a-8a9c-eff1a9706087 tempest-VolumesExtendTest-369352883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b29e605e-52dd-4c4a-8a9c-eff1a9706087 tempest-VolumesExtendTest-369352883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:47 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a596f679-9bb8-4a72-a57a-0e88b87bcc08]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b29e605e-52dd-4c4a-8a9c-eff1a9706087 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b29e605e-52dd-4c4a-8a9c-eff1a9706087 tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef" returned: 0 in 0.526s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b29e605e-52dd-4c4a-8a9c-eff1a9706087 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe 2G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:48 devstack quobyte-client[82822]: System call of process 95403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b29e605e-52dd-4c4a-8a9c-eff1a9706087 tempest-VolumesExtendTest-369352883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe 2G" returned: 0 in 0.267s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b29e605e-52dd-4c4a-8a9c-eff1a9706087 tempest-VolumesExtendTest-369352883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.913s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b29e605e-52dd-4c4a-8a9c-eff1a9706087 tempest-VolumesExtendTest-369352883 None] Extend volume completed successfully.
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Acquiring lock "cinder-a17eeae9-e26a-4285-acd3-93bbc7fefdbe-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Lock "cinder-a17eeae9-e26a-4285-acd3-93bbc7fefdbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.109s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:50 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Acquiring lock "cinder-quobyte-647063b6-9193-4501-9f90-224f2c8d79ef" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Lock "cinder-quobyte-647063b6-9193-4501-9f90-224f2c8d79ef" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Acquiring lock "cinder-quobyte-a17eeae9-e26a-4285-acd3-93bbc7fefdbe" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Lock "cinder-quobyte-a17eeae9-e26a-4285-acd3-93bbc7fefdbe" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Deleting offline snapshot a17eeae9-e26a-4285-acd3-93bbc7fefdbe of volume 647063b6-9193-4501-9f90-224f2c8d79ef {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] snapshot_file for this snap is: volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb6e0b7-d131-4d07-a532-21138827fa93]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe" returned: 0 in 0.555s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-647063b6-9193-4501-9f90-224f2c8d79ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:46:51 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[381544d9-4633-44dc-a23e-426156ead0f8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef" returned: 0 in 0.663s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:52 devstack quobyte-client[82822]: System call of process 95414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:46:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe" returned: 0 in 0.349s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef.a17eeae9-e26a-4285-acd3-93bbc7fefdbe" returned: 0 in 0.154s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Lock "cinder-quobyte-a17eeae9-e26a-4285-acd3-93bbc7fefdbe" released by "_delete_snapshot" :: held 2.277s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Lock "cinder-quobyte-647063b6-9193-4501-9f90-224f2c8d79ef" released by "delete_snapshot" :: held 2.361s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:53 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Created reservations ['fd257e63-4d40-4d64-bad5-cdfa133fae31', '8b576913-abfc-4f03-a21e-09dfbd129af4', '70aaebfe-9f33-4436-827f-deda88fb814b', 'f4d0a51c-8b5a-4670-8540-a899a0a9d084'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Delete snapshot completed successfully.
Sep 18 13:46:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-58cc9be2-2686-4f24-88ab-4a09f38160ff tempest-VolumesExtendTest-369352883 None] Lock "cinder-a17eeae9-e26a-4285-acd3-93bbc7fefdbe-delete_snapshot" released by "delete_snapshot" :: held 3.006s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Acquiring lock "cinder-647063b6-9193-4501-9f90-224f2c8d79ef-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Lock "cinder-647063b6-9193-4501-9f90-224f2c8d79ef-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:53 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:46:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Acquiring lock "cinder-quobyte-647063b6-9193-4501-9f90-224f2c8d79ef" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:46:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Lock "cinder-quobyte-647063b6-9193-4501-9f90-224f2c8d79ef" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:46:53 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c0569-e18a-41a7-9d97-8f8f795b8162]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:46:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef" returned: 0 in 0.851s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-647063b6-9193-4501-9f90-224f2c8d79ef" returned: 0 in 0.308s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Lock "cinder-quobyte-647063b6-9193-4501-9f90-224f2c8d79ef" released by "delete_volume" :: held 1.449s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:46:55 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Created reservations ['cf9acd2b-a835-4cc5-ad48-bae827b15ca2', '79bda183-382b-4b49-bc78-658fa3eefc04', 'ff3962a1-a59b-40f4-b5bc-80dfd2531b31', 'ffbde20c-5dee-41f6-bc76-e0a39ded7f56'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:46:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:46:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:46:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:46:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:46:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:46:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:46:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.458s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:46:56 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:46:56 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Deleted volume successfully.
Sep 18 13:46:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-face3bd0-9f2f-4ece-a2d9-f0b8db5b7779 tempest-VolumesExtendTest-369352883 None] Lock "cinder-647063b6-9193-4501-9f90-224f2c8d79ef-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:02 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:47:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Flow 'volume_create_manager' (48d84e8e-7a1e-4ff9-95b1-5a387df7ca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c73082-62e5-419d-b98e-e6dde2c161d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c73082-62e5-419d-b98e-e6dde2c161d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-999318066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0c30cf-40dc-40e6-abd4-4408de39af12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23630217be6242c1a3135e2c7e1342fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:02Z,use_quota=True,user_id='ced5dba72de6453b95d62aed89449c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af73695-c72b-4ff5-8c33-ab9e398ef619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af73695-c72b-4ff5-8c33-ab9e398ef619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca6817e-b9d4-4e74-b391-cacecf4a780e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca6817e-b9d4-4e74-b391-cacecf4a780e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad0c30cf-40dc-40e6-abd4-4408de39af12', 'volume_name': 'volume-ad0c30cf-40dc-40e6-abd4-4408de39af12', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a187d6-8883-4dd7-be5c-876f36f519f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a187d6-8883-4dd7-be5c-876f36f519f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4056afa1-ba72-43eb-8810-a3d88ec5b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:03 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Volume ad0c30cf-40dc-40e6-abd4-4408de39af12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad0c30cf-40dc-40e6-abd4-4408de39af12', 'volume_size': 1}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-999318066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0c30cf-40dc-40e6-abd4-4408de39af12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23630217be6242c1a3135e2c7e1342fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:02Z,use_quota=True,user_id='ced5dba72de6453b95d62aed89449c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Creating volume ad0c30cf-40dc-40e6-abd4-4408de39af12 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:47:03 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ad0c30cf-40dc-40e6-abd4-4408de39af12 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:03 devstack quobyte-client[82822]: System call of process 95450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:03 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=84, name=volume-ad0c30cf-40dc-40e6-abd4-4408de39af12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ad0c30cf-40dc-40e6-abd4-4408de39af12 1073741824" returned: 0 in 0.653s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ad0c30cf-40dc-40e6-abd4-4408de39af12 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ad0c30cf-40dc-40e6-abd4-4408de39af12" returned: 0 in 0.174s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] <== create_volume: return (923ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:47:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4056afa1-ba72-43eb-8810-a3d88ec5b62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad0c30cf-40dc-40e6-abd4-4408de39af12', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fe8d03-7c68-48a6-9b4d-d9cf33beed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:04 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Volume volume-ad0c30cf-40dc-40e6-abd4-4408de39af12 (ad0c30cf-40dc-40e6-abd4-4408de39af12): created successfully
Sep 18 13:47:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fe8d03-7c68-48a6-9b4d-d9cf33beed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Flow 'volume_create_manager' (48d84e8e-7a1e-4ff9-95b1-5a387df7ca45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:04 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-acb9dca5-b13e-46df-92a6-c5ba125ee95b tempest-VolumesListTestJSON-1189518433 None] Created volume successfully.
Sep 18 13:47:06 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Flow 'volume_create_manager' (2ad7223c-2b37-4b0e-80db-c4052f4bc88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b5f4f1-fc98-4e2c-a9ea-8bd575483e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b5f4f1-fc98-4e2c-a9ea-8bd575483e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-555444119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f5d61a-caa9-4449-a528-703e89b11fff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23630217be6242c1a3135e2c7e1342fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:06Z,use_quota=True,user_id='ced5dba72de6453b95d62aed89449c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e685b777-c837-4476-a31f-df4dfd9519e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e685b777-c837-4476-a31f-df4dfd9519e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c670b8e3-a215-4257-9deb-2ea6eb891215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c670b8e3-a215-4257-9deb-2ea6eb891215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f5d61a-caa9-4449-a528-703e89b11fff', 'volume_name': 'volume-92f5d61a-caa9-4449-a528-703e89b11fff', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae7480c-c3c6-4a2f-84a8-aa58cd8964a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae7480c-c3c6-4a2f-84a8-aa58cd8964a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b61769-0d08-4b0c-bf05-0978a43ee542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:06 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Volume 92f5d61a-caa9-4449-a528-703e89b11fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f5d61a-caa9-4449-a528-703e89b11fff', 'volume_size': 1}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-555444119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f5d61a-caa9-4449-a528-703e89b11fff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23630217be6242c1a3135e2c7e1342fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:06Z,use_quota=True,user_id='ced5dba72de6453b95d62aed89449c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Creating volume 92f5d61a-caa9-4449-a528-703e89b11fff {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:47:06 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:47:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-92f5d61a-caa9-4449-a528-703e89b11fff 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:06 devstack quobyte-client[82822]: System call of process 95455 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:06 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=85, name=volume-92f5d61a-caa9-4449-a528-703e89b11fff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-92f5d61a-caa9-4449-a528-703e89b11fff 1073741824" returned: 0 in 0.720s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-92f5d61a-caa9-4449-a528-703e89b11fff {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-92f5d61a-caa9-4449-a528-703e89b11fff" returned: 0 in 0.265s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] <== create_volume: return (1114ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:47:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b61769-0d08-4b0c-bf05-0978a43ee542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f5d61a-caa9-4449-a528-703e89b11fff', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00934e50-aecc-4958-83c8-5eed8c67f951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:08 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Volume volume-92f5d61a-caa9-4449-a528-703e89b11fff (92f5d61a-caa9-4449-a528-703e89b11fff): created successfully
Sep 18 13:47:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00934e50-aecc-4958-83c8-5eed8c67f951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Flow 'volume_create_manager' (2ad7223c-2b37-4b0e-80db-c4052f4bc88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:08 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9e391908-e2bf-4d14-9929-5c7f220f5a8d tempest-VolumesListTestJSON-1189518433 None] Created volume successfully.
Sep 18 13:47:10 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Flow 'volume_create_manager' (158cc886-a018-42e2-9a0d-b158372b3c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9860a81-4a15-4a58-8765-3bcac579a406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9860a81-4a15-4a58-8765-3bcac579a406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-301455914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac63f68-5ebc-4287-8600-153541e11447,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23630217be6242c1a3135e2c7e1342fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:10Z,use_quota=True,user_id='ced5dba72de6453b95d62aed89449c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15ee98e-b602-475c-9d6c-259c546b4652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15ee98e-b602-475c-9d6c-259c546b4652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044bafd6-97d2-4316-aed0-779351847383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044bafd6-97d2-4316-aed0-779351847383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac63f68-5ebc-4287-8600-153541e11447', 'volume_name': 'volume-0ac63f68-5ebc-4287-8600-153541e11447', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bdd0ec-4e73-48a4-9db1-dd0755377044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bdd0ec-4e73-48a4-9db1-dd0755377044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fd369c-1cc3-47b8-9b74-189a582f59d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:10 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Volume 0ac63f68-5ebc-4287-8600-153541e11447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac63f68-5ebc-4287-8600-153541e11447', 'volume_size': 1}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-301455914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac63f68-5ebc-4287-8600-153541e11447,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23630217be6242c1a3135e2c7e1342fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:10Z,use_quota=True,user_id='ced5dba72de6453b95d62aed89449c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Creating volume 0ac63f68-5ebc-4287-8600-153541e11447 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:47:10 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0ac63f68-5ebc-4287-8600-153541e11447 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:10 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=86, name=volume-0ac63f68-5ebc-4287-8600-153541e11447, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0ac63f68-5ebc-4287-8600-153541e11447 1073741824" returned: 0 in 0.375s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0ac63f68-5ebc-4287-8600-153541e11447 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0ac63f68-5ebc-4287-8600-153541e11447" returned: 0 in 0.095s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] <== create_volume: return (543ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:47:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.555s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fd369c-1cc3-47b8-9b74-189a582f59d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac63f68-5ebc-4287-8600-153541e11447', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630c9ab4-c6bd-4dcf-91b6-8faaf8c20861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Volume volume-0ac63f68-5ebc-4287-8600-153541e11447 (0ac63f68-5ebc-4287-8600-153541e11447): created successfully
Sep 18 13:47:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630c9ab4-c6bd-4dcf-91b6-8faaf8c20861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Flow 'volume_create_manager' (158cc886-a018-42e2-9a0d-b158372b3c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:11 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bb633191-0353-49b7-9bf8-9522f5dd7471 tempest-VolumesListTestJSON-1189518433 None] Created volume successfully.
Sep 18 13:47:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:47:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.125s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:47:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "cinder-0ac63f68-5ebc-4287-8600-153541e11447-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-0ac63f68-5ebc-4287-8600-153541e11447-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "cinder-quobyte-0ac63f68-5ebc-4287-8600-153541e11447" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-quobyte-0ac63f68-5ebc-4287-8600-153541e11447" acquired by "delete_volume" :: waited 0.021s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:16 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0204a0f4-83ed-4139-a103-76177e8e7e21]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0ac63f68-5ebc-4287-8600-153541e11447 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0ac63f68-5ebc-4287-8600-153541e11447" returned: 0 in 0.501s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0ac63f68-5ebc-4287-8600-153541e11447 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0ac63f68-5ebc-4287-8600-153541e11447" returned: 0 in 0.293s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-quobyte-0ac63f68-5ebc-4287-8600-153541e11447" released by "delete_volume" :: held 0.972s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Created reservations ['fb26627f-c40a-4ce9-9d99-5769c7f1bade', 'c598975a-09cc-47cf-bd7d-77adf0648358', '20d33201-0468-458f-8dc2-2bc59323812a', 'eae10386-11e1-462c-8128-7e4bce1c64ff'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.133s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:47:17 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Deleted volume successfully.
Sep 18 13:47:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-66ea942f-617c-4b43-ac74-38d4025d3e40 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-0ac63f68-5ebc-4287-8600-153541e11447-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "cinder-92f5d61a-caa9-4449-a528-703e89b11fff-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-92f5d61a-caa9-4449-a528-703e89b11fff-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:18 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "cinder-quobyte-92f5d61a-caa9-4449-a528-703e89b11fff" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-quobyte-92f5d61a-caa9-4449-a528-703e89b11fff" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:18 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cba1c9b-063d-4ba0-ad81-6e6aed251234]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-92f5d61a-caa9-4449-a528-703e89b11fff {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-92f5d61a-caa9-4449-a528-703e89b11fff" returned: 0 in 0.528s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-92f5d61a-caa9-4449-a528-703e89b11fff {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-92f5d61a-caa9-4449-a528-703e89b11fff" returned: 0 in 0.126s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-quobyte-92f5d61a-caa9-4449-a528-703e89b11fff" released by "delete_volume" :: held 0.817s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Created reservations ['2c6e8e85-a073-4e81-ad69-9cc43d43a4a8', '8cc4a0cd-c246-4675-9b27-fc886468093c', 'bfe8ec4b-0007-47e9-8866-8af73a3f76e3', 'a347d53e-2b6d-4781-8f6a-f1eda49b616f'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.229s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:20 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:47:20 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Deleted volume successfully.
Sep 18 13:47:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b2ea9979-fba7-453e-a7ce-46d15a50d595 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-92f5d61a-caa9-4449-a528-703e89b11fff-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "cinder-ad0c30cf-40dc-40e6-abd4-4408de39af12-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-ad0c30cf-40dc-40e6-abd4-4408de39af12-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:21 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "cinder-quobyte-ad0c30cf-40dc-40e6-abd4-4408de39af12" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-quobyte-ad0c30cf-40dc-40e6-abd4-4408de39af12" acquired by "delete_volume" :: waited 0.031s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:21 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aac6d0b-1a87-4916-9ed0-88c671e4b776]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ad0c30cf-40dc-40e6-abd4-4408de39af12 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ad0c30cf-40dc-40e6-abd4-4408de39af12" returned: 0 in 0.654s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ad0c30cf-40dc-40e6-abd4-4408de39af12 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ad0c30cf-40dc-40e6-abd4-4408de39af12" returned: 0 in 0.192s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-quobyte-ad0c30cf-40dc-40e6-abd4-4408de39af12" released by "delete_volume" :: held 1.087s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:22 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Created reservations ['eb33d51d-239b-407e-b559-282227a6b865', 'a8a459e9-70d2-42f5-928f-a8167ab1afd6', 'a538843e-9024-41e3-9994-f2cabfabee82', 'a2ddc91e-fddd-4720-b55a-e93a02c2c29d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:47:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:23 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:23 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.155s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:23 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:47:23 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Deleted volume successfully.
Sep 18 13:47:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b902a7be-b374-4f08-adee-9101f5e73de3 tempest-VolumesListTestJSON-1189518433 None] Lock "cinder-ad0c30cf-40dc-40e6-abd4-4408de39af12-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:25 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:25 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:47:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Flow 'volume_create_manager' (22729380-cf6e-4828-9b2c-ef7b9895bb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1531b8f-1d2c-45f8-9428-487351148742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1531b8f-1d2c-45f8-9428-487351148742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1544441642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1e3553-8882-48c8-ad76-33fc4de10578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f97e20fdd1549d7a87b65b64a108cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:26Z,use_quota=True,user_id='13c2d8b55ff84dd384e536f24266896f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610591b4-afe5-4ab7-b677-a08f939adfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610591b4-afe5-4ab7-b677-a08f939adfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72325414-1d70-4ba4-bffc-5512d4f0b930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72325414-1d70-4ba4-bffc-5512d4f0b930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1e3553-8882-48c8-ad76-33fc4de10578', 'volume_name': 'volume-5b1e3553-8882-48c8-ad76-33fc4de10578', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b767030b-2c37-44e8-abd7-e200a98e0a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b767030b-2c37-44e8-abd7-e200a98e0a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa5a1ea-5888-472a-86a9-6222680123a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:26 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Volume 5b1e3553-8882-48c8-ad76-33fc4de10578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1e3553-8882-48c8-ad76-33fc4de10578', 'volume_size': 1}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1544441642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1e3553-8882-48c8-ad76-33fc4de10578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f97e20fdd1549d7a87b65b64a108cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:26Z,use_quota=True,user_id='13c2d8b55ff84dd384e536f24266896f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Creating volume 5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:47:26 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:26 devstack quobyte-client[82822]: System call of process 95486 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:26 devstack quobyte-client[82822]: System call of process 95486 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:26 devstack quobyte-client[82822]: System call of process 95486 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:26 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=87, name=volume-5b1e3553-8882-48c8-ad76-33fc4de10578, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 1073741824" returned: 0 in 0.383s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578" returned: 0 in 0.103s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] <== create_volume: return (591ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.606s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa5a1ea-5888-472a-86a9-6222680123a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1e3553-8882-48c8-ad76-33fc4de10578', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3845ebd-8a04-491b-9971-8edee4e20cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:27 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Volume volume-5b1e3553-8882-48c8-ad76-33fc4de10578 (5b1e3553-8882-48c8-ad76-33fc4de10578): created successfully
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3845ebd-8a04-491b-9971-8edee4e20cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Flow 'volume_create_manager' (22729380-cf6e-4828-9b2c-ef7b9895bb41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:27 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-89c16fab-6040-459a-8f05-18e94bd5f0f1 tempest-SnapshotDependencyTests-1339324235 None] Created volume successfully.
Sep 18 13:47:27 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Flow 'volume_create_manager' (236d5067-43b9-4129-898c-47fbd81769ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a648326-b019-4cd6-9a31-83a0b752dbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a648326-b019-4cd6-9a31-83a0b752dbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-990165124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b8f672-259e-4ee3-ac06-378d7b43a38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7ef9f10640ec802d2e2da24f793f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:27Z,use_quota=True,user_id='435d9eac2c094e3dbb34495b5e9ac7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730d618b-63a0-4bb7-87aa-563a2ced3c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730d618b-63a0-4bb7-87aa-563a2ced3c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a7920b-948a-4d28-832e-e169e5b1b29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a7920b-948a-4d28-832e-e169e5b1b29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b8f672-259e-4ee3-ac06-378d7b43a38e', 'volume_name': 'volume-20b8f672-259e-4ee3-ac06-378d7b43a38e', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab57699-0fe5-40a2-a19e-4fdf94c32f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab57699-0fe5-40a2-a19e-4fdf94c32f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72843554-1669-4651-996b-cddc4d749ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:27 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Volume 20b8f672-259e-4ee3-ac06-378d7b43a38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b8f672-259e-4ee3-ac06-378d7b43a38e', 'volume_size': 1}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-990165124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b8f672-259e-4ee3-ac06-378d7b43a38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7ef9f10640ec802d2e2da24f793f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:27Z,use_quota=True,user_id='435d9eac2c094e3dbb34495b5e9ac7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Creating volume 20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:47:27 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:27 devstack quobyte-client[82822]: System call of process 95490 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:27 devstack quobyte-client[82822]: System call of process 95490 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:27 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=88, name=volume-20b8f672-259e-4ee3-ac06-378d7b43a38e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e 1073741824" returned: 0 in 0.311s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e" returned: 0 in 0.106s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] <== create_volume: return (491ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.502s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:INSERT=25,cinder:SELECT=59,cinder:DELETE=6,cinder:UPDATE=87 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72843554-1669-4651-996b-cddc4d749ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b8f672-259e-4ee3-ac06-378d7b43a38e', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea77e49-b46d-40cf-856a-f81f207388bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=64,cinder:INSERT=23,cinder:UPDATE=87,cinder:DELETE=9 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:47:28 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-ebff6116-2d88-40d0-bab2-6f9aef8b19b7 req-53880d16-cc8c-40fd-ac35-27eab7820bdf tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:28 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Volume volume-20b8f672-259e-4ee3-ac06-378d7b43a38e (20b8f672-259e-4ee3-ac06-378d7b43a38e): created successfully
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea77e49-b46d-40cf-856a-f81f207388bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Flow 'volume_create_manager' (236d5067-43b9-4129-898c-47fbd81769ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:28 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-ebff6116-2d88-40d0-bab2-6f9aef8b19b7 req-53880d16-cc8c-40fd-ac35-27eab7820bdf tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:28 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-ebff6116-2d88-40d0-bab2-6f9aef8b19b7 req-53880d16-cc8c-40fd-ac35-27eab7820bdf tempest-AttachVolumeTestJSON-1035035170 None] Terminate volume connection completed successfully.
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-ebff6116-2d88-40d0-bab2-6f9aef8b19b7 req-53880d16-cc8c-40fd-ac35-27eab7820bdf tempest-AttachVolumeTestJSON-1035035170 None] Deleting attachment f0e60db2-0dc2-44d5-be77-c760aebf2d0a. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:47:28 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-006cd44a-2022-4915-a77f-049e81b71a24 tempest-VolumesSnapshotListTestJSON-708393606 None] Created volume successfully.
Sep 18 13:47:28 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Creating offline snapshot b696ed7a-1a82-46f0-9d41-738b42aa50c7 of volume 5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e2e4f9-58a4-417f-b31d-5027957f00fa]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578" returned: 0 in 0.431s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:29 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=89, name=volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 1G" returned: 0 in 0.268s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5b1e3553-8882-48c8-ad76-33fc4de10578 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] CMD "qemu-img rebase -u -b volume-5b1e3553-8882-48c8-ad76-33fc4de10578 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7" returned: 0 in 0.159s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:29 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:47:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7" returned: 0 in 0.106s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7" returned: 0 in 0.135s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.info" returned: 0 in 0.475s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:30 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.info" returned: 0 in 0.209s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.256s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Creating offline snapshot d5cef632-8c48-49d7-8f23-839cc7f8b5e5 of volume 20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:47:31 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b0eeac7b-5bdf-4230-a377-b11eb21d8ae6 tempest-SnapshotDependencyTests-1339324235 None] Create snapshot completed successfully
Sep 18 13:47:31 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[2375d277-0df3-4ec1-b9d9-e0c557c88973]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e" returned: 0 in 0.451s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:31 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=91, name=volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 1G" returned: 0 in 0.271s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img rebase -u -b volume-20b8f672-259e-4ee3-ac06-378d7b43a38e -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img rebase -u -b volume-20b8f672-259e-4ee3-ac06-378d7b43a38e -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5" returned: 0 in 0.198s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:47:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5" returned: 0 in 0.173s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:47:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5" returned: 0 in 1.295s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.info" returned: 0 in 0.187s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.info" returned: 0 in 0.334s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.424s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Flow 'volume_create_manager' (18c1a210-760f-45cd-95c0-f7aca4b38eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2204919e-2bbe-476c-aff2-ff57ea2fc965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2204919e-2bbe-476c-aff2-ff57ea2fc965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c7294d-fb9b-4f26-990c-c959ce9f78a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f97e20fdd1549d7a87b65b64a108cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b696ed7a-1a82-46f0-9d41-738b42aa50c7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:47:33Z,use_quota=True,user_id='13c2d8b55ff84dd384e536f24266896f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bf304d-7853-4562-8ff2-3abf0b9af4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bf304d-7853-4562-8ff2-3abf0b9af4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95221063-801f-4858-8a09-bd74fe43efea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95221063-801f-4858-8a09-bd74fe43efea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33c7294d-fb9b-4f26-990c-c959ce9f78a0', 'volume_name': 'volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0', 'volume_size': 1, 'snapshot_id': 'b696ed7a-1a82-46f0-9d41-738b42aa50c7'}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b235f7-19ed-4534-8f69-cdf9e3b16a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b235f7-19ed-4534-8f69-cdf9e3b16a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30e451e-b149-4988-b207-9b97fd3d58ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:34 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Volume 33c7294d-fb9b-4f26-990c-c959ce9f78a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0', 'volume_size': 1, 'snapshot_id': 'b696ed7a-1a82-46f0-9d41-738b42aa50c7'}
Sep 18 13:47:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-24762671-5d4b-419b-a637-81c9028ae53c tempest-VolumesSnapshotListTestJSON-708393606 None] Create snapshot completed successfully
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "cinder-quobyte-b696ed7a-1a82-46f0-9d41-738b42aa50c7-33c7294d-fb9b-4f26-990c-c959ce9f78a0" by "_create_volume_from_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-b696ed7a-1a82-46f0-9d41-738b42aa50c7-33c7294d-fb9b-4f26-990c-c959ce9f78a0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Creating volume 33c7294d-fb9b-4f26-990c-c959ce9f78a0 from snapshot b696ed7a-1a82-46f0-9d41-738b42aa50c7 {{(pid=82799) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "cinder-quobyte-33c7294d-fb9b-4f26-990c-c959ce9f78a0" by "_copy_volume_from_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-33c7294d-fb9b-4f26-990c-c959ce9f78a0" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] snapshot: b696ed7a-1a82-46f0-9d41-738b42aa50c7, volume: 33c7294d-fb9b-4f26-990c-c959ce9f78a0,  {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b48075-91e9-4d69-8880-2bb77b35b2af]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7" returned: 0 in 0.956s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b1e3553-8882-48c8-ad76-33fc4de10578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:47:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 13:47:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Creating direct copy from snapshot {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 13:47:36 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae11504-0fa2-4df5-96ed-b9fb8caf26d1]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:36 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578" returned: 0 in 0.633s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:37 devstack cinder-volume[82799]: DEBUG cinder.utils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0 not found in is_blk_device check {{(pid=82799) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 13:47:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:37 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=93, name=volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0" returned: 0 in 7.859s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:44 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9de02ba-43b2-4f61-8b60-23bcab72c61b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578" returned: 0 in 0.720s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:45 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Image conversion details: src /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578, size 1024.00 MB, duration 7.89 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0 {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:47:45 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Converted 1024.00 MB image at 129.80 MB/s
Sep 18 13:47:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:47:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0" returned: 0 in 0.106s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:45 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-33c7294d-fb9b-4f26-990c-c959ce9f78a0" released by "_copy_volume_from_snapshot" :: held 10.869s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:45 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-b696ed7a-1a82-46f0-9d41-738b42aa50c7-33c7294d-fb9b-4f26-990c-c959ce9f78a0" released by "_create_volume_from_snapshot" :: held 10.929s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.956s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.237s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Creating offline snapshot 4727459e-63f4-4701-bd8f-c138bdb5f102 of volume 20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e2be9c-ee71-4f04-8cef-227197f10120]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30e451e-b149-4988-b207-9b97fd3d58ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0', 'volume_size': 1, 'snapshot_id': 'b696ed7a-1a82-46f0-9d41-738b42aa50c7'}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a89937f-5001-481a-9c3b-8a01334f1822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:47:46 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Volume volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0 (33c7294d-fb9b-4f26-990c-c959ce9f78a0): created successfully
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a89937f-5001-481a-9c3b-8a01334f1822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Flow 'volume_create_manager' (18c1a210-760f-45cd-95c0-f7aca4b38eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5" returned: 0 in 0.768s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b8f672-259e-4ee3-ac06-378d7b43a38e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:47:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:47 devstack quobyte-client[82822]: System call of process 95644 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:47 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-29a75e4e-d304-4e46-8064-87deb437ca0d tempest-SnapshotDependencyTests-1339324235 None] Created volume successfully.
Sep 18 13:47:47 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=94, name=volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 1G" returned: 0 in 0.414s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img rebase -u -b volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:47 devstack quobyte-client[82822]: System call of process 95648 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img rebase -u -b volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102" returned: 0 in 0.164s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:47:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102" returned: 0 in 0.127s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:47:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "cinder-b696ed7a-1a82-46f0-9d41-738b42aa50c7-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102" returned: 0 in 0.362s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-b696ed7a-1a82-46f0-9d41-738b42aa50c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.290s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:48 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "cinder-quobyte-5b1e3553-8882-48c8-ad76-33fc4de10578" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-5b1e3553-8882-48c8-ad76-33fc4de10578" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "cinder-quobyte-b696ed7a-1a82-46f0-9d41-738b42aa50c7" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:48 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3c39d8e1-32cb-45ff-ae0f-2f465dd5272d tempest-VolumesSnapshotListTestJSON-708393606 None] Create snapshot completed successfully
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-b696ed7a-1a82-46f0-9d41-738b42aa50c7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Deleting offline snapshot b696ed7a-1a82-46f0-9d41-738b42aa50c7 of volume 5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] snapshot_file for this snap is: volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d519f3d3-23d2-4850-8751-191680f73e53]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7" returned: 0 in 0.480s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b1e3553-8882-48c8-ad76-33fc4de10578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:47:49 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b914837-f2bb-436b-be1c-6f878f621c7b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:49 devstack quobyte-client[82822]: System call of process 95661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578" returned: 0 in 1.048s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:50 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:47:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:47:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7" returned: 0 in 0.390s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Creating offline snapshot 73079180-baf4-441a-b7ae-9380da31923f of volume 20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:47:50 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea91e2a-7b52-4007-8b89-5c708d045cba]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578.b696ed7a-1a82-46f0-9d41-738b42aa50c7" returned: 0 in 0.562s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-b696ed7a-1a82-46f0-9d41-738b42aa50c7" released by "_delete_snapshot" :: held 2.824s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-5b1e3553-8882-48c8-ad76-33fc4de10578" released by "delete_snapshot" :: held 2.872s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102" returned: 0 in 0.835s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b8f672-259e-4ee3-ac06-378d7b43a38e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:47:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:52 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=95, name=volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:47:52 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Created reservations ['1e9934e9-8dce-436f-9fbc-fdbef6601fcc', 'e4887e44-79e1-4801-b692-86bacfd89210', 'd39fd0d4-903e-43fa-b682-45bfea8f212a', '1b4d500d-d35e-4a85-9607-ebccc96fe9f1'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:47:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f 1G" returned: 0 in 0.503s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img rebase -u -b volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:52 devstack quobyte-client[82822]: System call of process 95691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img rebase -u -b volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f" returned: 0 in 0.369s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:47:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:52 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Delete snapshot completed successfully.
Sep 18 13:47:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f" returned: 0 in 0.298s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:47:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ca18c43a-9bbe-4983-a464-fd3d95cc95d1 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-b696ed7a-1a82-46f0-9d41-738b42aa50c7-delete_snapshot" released by "delete_snapshot" :: held 4.741s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f" returned: 0 in 0.258s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.803s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:47:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "cinder-5b1e3553-8882-48c8-ad76-33fc4de10578-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-5b1e3553-8882-48c8-ad76-33fc4de10578-delete_volume" acquired by "delete_volume" :: waited 0.278s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9b3dfc3a-b36f-48ef-862e-bcf1db34e74c tempest-VolumesSnapshotListTestJSON-708393606 None] Create snapshot completed successfully
Sep 18 13:47:54 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "cinder-quobyte-5b1e3553-8882-48c8-ad76-33fc4de10578" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-5b1e3553-8882-48c8-ad76-33fc4de10578" acquired by "delete_volume" :: waited 0.046s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:54 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[69746076-a295-44d4-b95b-c87e85547396]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:57 devstack quobyte-client[82822]: System call of process 95719 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:47:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578" returned: 0 in 3.173s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:47:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5b1e3553-8882-48c8-ad76-33fc4de10578" returned: 0 in 0.289s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:47:58 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-5b1e3553-8882-48c8-ad76-33fc4de10578" released by "delete_volume" :: held 4.130s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:47:58 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-73079180-baf4-441a-b7ae-9380da31923f-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-73079180-baf4-441a-b7ae-9380da31923f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.117s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Created reservations ['7d2c3ba8-6818-48c8-80a7-c74dfd70ed1b', '25efcf5c-826c-4f43-9420-b0b199e49966', '0547e749-1d43-458f-aa02-ff568480f815', '7c5e17a3-d2f9-44db-86dc-612f22b67710'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" acquired by "delete_snapshot" :: waited 0.264s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-quobyte-73079180-baf4-441a-b7ae-9380da31923f" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-73079180-baf4-441a-b7ae-9380da31923f" acquired by "_delete_snapshot" :: waited 0.115s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Deleting offline snapshot 73079180-baf4-441a-b7ae-9380da31923f of volume 20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] snapshot_file for this snap is: volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbebaee-5e20-4c28-82c3-d6e207864033]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:47:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f" returned: 0 in 1.175s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b8f672-259e-4ee3-ac06-378d7b43a38e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:48:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:48:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:48:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:48:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:48:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:48:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:01 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43691d9-a807-4aa1-83cb-6c60abf0e64c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:48:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "cinder-33c7294d-fb9b-4f26-990c-c959ce9f78a0-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 1.569s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:02 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:48:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-33c7294d-fb9b-4f26-990c-c959ce9f78a0-delete_volume" acquired by "delete_volume" :: waited 0.278s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:02 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Deleted volume successfully.
Sep 18 13:48:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102" returned: 0 in 1.287s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b8f672-259e-4ee3-ac06-378d7b43a38e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:48:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:02 devstack quobyte-client[82822]: System call of process 95781 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:48:03 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "cinder-quobyte-33c7294d-fb9b-4f26-990c-c959ce9f78a0" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0ca24f0-7857-4e6d-a05f-2500959e31dc tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-5b1e3553-8882-48c8-ad76-33fc4de10578-delete_volume" released by "delete_volume" :: held 9.583s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-33c7294d-fb9b-4f26-990c-c959ce9f78a0" acquired by "delete_volume" :: waited 0.111s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f" returned: 0 in 0.649s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34ce1a6-1286-422a-bd6f-c8cf019df763]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.73079180-baf4-441a-b7ae-9380da31923f" returned: 0 in 0.385s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-73079180-baf4-441a-b7ae-9380da31923f" released by "_delete_snapshot" :: held 4.434s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" released by "delete_snapshot" :: held 4.565s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:04 devstack quobyte-client[82822]: System call of process 95785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:48:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0" returned: 0 in 0.795s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-33c7294d-fb9b-4f26-990c-c959ce9f78a0" returned: 0 in 0.308s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-quobyte-33c7294d-fb9b-4f26-990c-c959ce9f78a0" released by "delete_volume" :: held 1.358s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:04 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Created reservations ['e200f2b9-e49d-4d69-9afd-41f15d92bd55', 'e1bf5de9-ad80-4642-affc-ccff7214d46e', 'e20b240c-52c2-43f8-b9cc-8c8a9addd916', 'a6cafa49-ece7-465e-94f3-d2ae81049bee'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:48:04 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Created reservations ['0be41bec-dcfb-47ec-9ff9-b55f8a9c13c7', '47b6b9dd-678d-4e9a-bacc-341efdb490df', 'c9510bec-773b-45da-ab1d-8794a5265d35', '4e8a9921-ecd8-4acc-a16b-c3fb8d8c4e52'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:48:05 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Delete snapshot completed successfully.
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-34a5be1a-76c2-4a79-ae45-654dd620dfda tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-73079180-baf4-441a-b7ae-9380da31923f-delete_snapshot" released by "delete_snapshot" :: held 5.994s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.109s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:48:05 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Deleted volume successfully.
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-4727459e-63f4-4701-bd8f-c138bdb5f102-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7bdcd64c-0330-4436-b64c-b7551e101016 tempest-SnapshotDependencyTests-1339324235 None] Lock "cinder-33c7294d-fb9b-4f26-990c-c959ce9f78a0-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-4727459e-63f4-4701-bd8f-c138bdb5f102-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-quobyte-4727459e-63f4-4701-bd8f-c138bdb5f102" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-4727459e-63f4-4701-bd8f-c138bdb5f102" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Deleting offline snapshot 4727459e-63f4-4701-bd8f-c138bdb5f102 of volume 20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] snapshot_file for this snap is: volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e592b-336e-462b-9bac-b521e9e4a729]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:48:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102" returned: 0 in 0.567s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b8f672-259e-4ee3-ac06-378d7b43a38e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:48:06 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c2336-7588-4d65-bc22-35a36eb0bfa4]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:48:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:06 devstack quobyte-client[82822]: System call of process 95794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:48:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5" returned: 0 in 0.588s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b8f672-259e-4ee3-ac06-378d7b43a38e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:48:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102" returned: 0 in 0.318s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.4727459e-63f4-4701-bd8f-c138bdb5f102" returned: 0 in 0.130s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-4727459e-63f4-4701-bd8f-c138bdb5f102" released by "_delete_snapshot" :: held 2.133s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" released by "delete_snapshot" :: held 2.160s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:08 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Created reservations ['8017b1f6-0ea4-47d9-8bcb-8041c65a8978', '872ed495-abda-4e95-8cb5-5c8ab0f4c83a', '4ebc30a8-4249-41bf-8028-e74d1bf1f494', '38789b80-4548-4181-af1c-e172e94bf656'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:48:08 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Delete snapshot completed successfully.
Sep 18 13:48:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-56ca9560-4eff-4851-a350-792e71ea2a67 tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-4727459e-63f4-4701-bd8f-c138bdb5f102-delete_snapshot" released by "delete_snapshot" :: held 2.900s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-d5cef632-8c48-49d7-8f23-839cc7f8b5e5-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-d5cef632-8c48-49d7-8f23-839cc7f8b5e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-quobyte-d5cef632-8c48-49d7-8f23-839cc7f8b5e5" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-d5cef632-8c48-49d7-8f23-839cc7f8b5e5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Deleting offline snapshot d5cef632-8c48-49d7-8f23-839cc7f8b5e5 of volume 20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] snapshot_file for this snap is: volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f960fb-7158-4911-84a6-1b499ea08c67]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5" returned: 0 in 0.541s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b8f672-259e-4ee3-ac06-378d7b43a38e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1688a2-4398-4c26-814e-d81ec646a070]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:48:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:10 devstack quobyte-client[82822]: System call of process 95805 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:48:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e" returned: 0 in 0.666s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:10 devstack quobyte-client[82822]: System call of process 95809 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:48:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5" returned: 0 in 0.424s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e.d5cef632-8c48-49d7-8f23-839cc7f8b5e5" returned: 0 in 0.248s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-d5cef632-8c48-49d7-8f23-839cc7f8b5e5" released by "_delete_snapshot" :: held 2.346s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" released by "delete_snapshot" :: held 2.374s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:11 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Created reservations ['c8d91020-0887-4c15-8408-824c2be7cf48', '3d3af72b-ad97-4404-80e3-b4e4d85029a0', 'd1d1dbc9-ca79-4c40-ab40-eecbed56c94c', '0c6e27d4-139e-4598-bd10-903fa643a6a5'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:48:11 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Delete snapshot completed successfully.
Sep 18 13:48:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b444f109-5d8f-4e26-acae-5acc05ef95fd tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-d5cef632-8c48-49d7-8f23-839cc7f8b5e5-delete_snapshot" released by "delete_snapshot" :: held 2.910s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-20b8f672-259e-4ee3-ac06-378d7b43a38e-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-20b8f672-259e-4ee3-ac06-378d7b43a38e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:12 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:48:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" acquired by "delete_volume" :: waited 0.269s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:48:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.319s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:48:13 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[691b6154-231a-4874-96f3-d355bbb68842]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:48:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e" returned: 0 in 0.701s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-20b8f672-259e-4ee3-ac06-378d7b43a38e" returned: 0 in 0.123s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-quobyte-20b8f672-259e-4ee3-ac06-378d7b43a38e" released by "delete_volume" :: held 1.150s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Created reservations ['b771c6cc-02bd-49ad-8a21-a569e8812704', 'b38a2b98-3d8f-4ef4-8d12-ed2adfefdec7', 'f5c09bcd-e8a7-4fd4-9e76-166cb68497d8', '23ed87a5-1b50-483c-8e3a-5f42259a5dff'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.131s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:48:14 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:48:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Deleted volume successfully.
Sep 18 13:48:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-690a7350-2dd1-464e-a36f-b0f226de0faa tempest-VolumesSnapshotListTestJSON-708393606 None] Lock "cinder-20b8f672-259e-4ee3-ac06-378d7b43a38e-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:48:24 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=44,cinder:UPDATE=68,cinder:DELETE=5,cinder:INSERT=13 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:48:25 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=32,cinder:INSERT=15,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:49:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:49:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:49:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:49:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:49:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:49:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:49:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:49:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.124s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:49:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:49:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:49:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:50:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:50:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:50:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:50:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:50:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:50:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:50:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:50:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.120s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:50:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:50:24 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Flow 'volume_create_manager' (7fc86029-443a-473f-914a-393d9a132d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883fee89-b2d1-4f2b-80c4-829c026ed2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883fee89-b2d1-4f2b-80c4-829c026ed2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1170352837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf8e80d-0250-499e-b11d-2d8f97d48b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='008bb8a61f5f4d0da38983bb60585fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:50:24Z,use_quota=True,user_id='b0a44025f63c4c51bc0de1db27376f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f76177-9b73-47e7-8985-0af6e3b8a442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f76177-9b73-47e7-8985-0af6e3b8a442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92519bc5-2322-4d15-822a-c5f7e89dc117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92519bc5-2322-4d15-822a-c5f7e89dc117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf8e80d-0250-499e-b11d-2d8f97d48b57', 'volume_name': 'volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b4c4d9-b264-468b-9726-154c0a4ed19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b4c4d9-b264-468b-9726-154c0a4ed19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41476cac-b6d9-4235-b19a-199f292f6dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:24 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Volume dbf8e80d-0250-499e-b11d-2d8f97d48b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57', 'volume_size': 1}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1170352837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf8e80d-0250-499e-b11d-2d8f97d48b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='008bb8a61f5f4d0da38983bb60585fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:50:24Z,use_quota=True,user_id='b0a44025f63c4c51bc0de1db27376f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Creating volume dbf8e80d-0250-499e-b11d-2d8f97d48b57 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:50:24 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:50:24 devstack quobyte-client[82822]: System call of process 96241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:50:24 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=96, name=volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57 1073741824" returned: 0 in 0.453s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:50:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:50:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57" returned: 0 in 0.129s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:50:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] <== create_volume: return (652ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:50:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:50:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41476cac-b6d9-4235-b19a-199f292f6dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e2f04e-f23f-437e-a77c-f33dfcac38e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:25 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Volume volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57 (dbf8e80d-0250-499e-b11d-2d8f97d48b57): created successfully
Sep 18 13:50:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e2f04e-f23f-437e-a77c-f33dfcac38e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Flow 'volume_create_manager' (7fc86029-443a-473f-914a-393d9a132d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:50:25 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4d11f312-f4d2-4fb6-8e20-ed11db75ec1c tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Created volume successfully.
Sep 18 13:50:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-91e5bd52-5975-4bb6-a0d4-256795e16541 req-f0b23822-fd5c-426c-ad97-e95b56b1dc9b tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:50:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-91e5bd52-5975-4bb6-a0d4-256795e16541 req-f0b23822-fd5c-426c-ad97-e95b56b1dc9b tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:50:30 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[144dbb74-df66-46b8-af13-769f57858716]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:50:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-91e5bd52-5975-4bb6-a0d4-256795e16541 req-f0b23822-fd5c-426c-ad97-e95b56b1dc9b tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:50:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-91e5bd52-5975-4bb6-a0d4-256795e16541 req-f0b23822-fd5c-426c-ad97-e95b56b1dc9b tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57" returned: 0 in 0.437s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:50:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-91e5bd52-5975-4bb6-a0d4-256795e16541 req-f0b23822-fd5c-426c-ad97-e95b56b1dc9b tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.489s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:50:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-91e5bd52-5975-4bb6-a0d4-256795e16541 req-f0b23822-fd5c-426c-ad97-e95b56b1dc9b tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e83b3bde-4746-4e97-9730-b37b1ae37488', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:50:30 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-91e5bd52-5975-4bb6-a0d4-256795e16541 req-f0b23822-fd5c-426c-ad97-e95b56b1dc9b tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:50:30 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-91e5bd52-5975-4bb6-a0d4-256795e16541 req-f0b23822-fd5c-426c-ad97-e95b56b1dc9b tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] attachment_update completed successfully.
Sep 18 13:50:40 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:50:40 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:50:58 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Flow 'volume_create_manager' (74169621-38f0-4218-b61f-ba9af04d4d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f3cc52-7c82-4f04-9f81-9584910a9d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f3cc52-7c82-4f04-9f81-9584910a9d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-349312024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483a3d94-72dd-4828-8135-e7405c7d5b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b28fd393a314010977f43f20e53f328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:50:58Z,use_quota=True,user_id='0efec3c24758429f9391a38d43a55269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d70b431-1d9f-4406-b2c0-53fc037d3293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d70b431-1d9f-4406-b2c0-53fc037d3293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c424319-0d13-4fd2-bc2a-e7da40017716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c424319-0d13-4fd2-bc2a-e7da40017716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483a3d94-72dd-4828-8135-e7405c7d5b52', 'volume_name': 'volume-483a3d94-72dd-4828-8135-e7405c7d5b52', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55a68ef-ee10-4def-b272-92428cbc39f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55a68ef-ee10-4def-b272-92428cbc39f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b88b4bb-5e04-4835-8a4e-9b20d6c610cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:58 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Volume 483a3d94-72dd-4828-8135-e7405c7d5b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483a3d94-72dd-4828-8135-e7405c7d5b52', 'volume_size': 1}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-349312024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483a3d94-72dd-4828-8135-e7405c7d5b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b28fd393a314010977f43f20e53f328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:50:58Z,use_quota=True,user_id='0efec3c24758429f9391a38d43a55269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Creating volume 483a3d94-72dd-4828-8135-e7405c7d5b52 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:50:58 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:50:58 devstack quobyte-client[82822]: System call of process 96754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:50:58 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=97, name=volume-483a3d94-72dd-4828-8135-e7405c7d5b52, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52 1073741824" returned: 0 in 0.381s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52" returned: 0 in 0.086s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] <== create_volume: return (531ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:50:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.543s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:50:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b88b4bb-5e04-4835-8a4e-9b20d6c610cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483a3d94-72dd-4828-8135-e7405c7d5b52', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25f3586-231f-4dde-8184-53c973c46953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:50:59 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Volume volume-483a3d94-72dd-4828-8135-e7405c7d5b52 (483a3d94-72dd-4828-8135-e7405c7d5b52): created successfully
Sep 18 13:50:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25f3586-231f-4dde-8184-53c973c46953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:50:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Flow 'volume_create_manager' (74169621-38f0-4218-b61f-ba9af04d4d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:50:59 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0928e1c8-57ec-4959-a925-b5f807b0645e tempest-AttachVolumeTestJSON-1035035170 None] Created volume successfully.
Sep 18 13:51:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-955e3004-8d97-4b1e-9421-2a0609592e62 req-5f4d4682-e2d4-4870-a40a-678bd3784274 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:51:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-955e3004-8d97-4b1e-9421-2a0609592e62 req-5f4d4682-e2d4-4870-a40a-678bd3784274 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:51:00 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-955e3004-8d97-4b1e-9421-2a0609592e62 req-5f4d4682-e2d4-4870-a40a-678bd3784274 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Terminate volume connection completed successfully.
Sep 18 13:51:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-955e3004-8d97-4b1e-9421-2a0609592e62 req-5f4d4682-e2d4-4870-a40a-678bd3784274 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Deleting attachment e83b3bde-4746-4e97-9730-b37b1ae37488. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:51:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Acquiring lock "cinder-dbf8e80d-0250-499e-b11d-2d8f97d48b57-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:51:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "cinder-dbf8e80d-0250-499e-b11d-2d8f97d48b57-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:51:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:51:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Acquiring lock "cinder-quobyte-dbf8e80d-0250-499e-b11d-2d8f97d48b57" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:51:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "cinder-quobyte-dbf8e80d-0250-499e-b11d-2d8f97d48b57" acquired by "delete_volume" :: waited 0.019s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:51:02 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[de271830-143f-4b46-aaaf-a7c0d105705d]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:51:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:51:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57" returned: 0 in 0.488s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:51:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dbf8e80d-0250-499e-b11d-2d8f97d48b57" returned: 0 in 0.082s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "cinder-quobyte-dbf8e80d-0250-499e-b11d-2d8f97d48b57" released by "delete_volume" :: held 0.763s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Created reservations ['32bfe68f-1790-4d02-82cb-09d0254aa329', '671f4d21-4af9-4595-862b-648b1f899cba', '9faca898-8cfa-480c-955e-b93d6efb282e', '249abc08-fd2a-4d69-9989-0ad6d2afc60a'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.118s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:51:03 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:51:04 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Deleted volume successfully.
Sep 18 13:51:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-88efb6af-44da-4f9b-8ecf-d443cd198489 tempest-TestServerVolumeAttachScenarioOldVersion-408242595 None] Lock "cinder-dbf8e80d-0250-499e-b11d-2d8f97d48b57-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:51:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cc6d8a2e-c23d-47a6-9e4b-2cdf27c831f3 req-57a7edd6-cd8e-41ae-ad43-c17fd6e0e35d tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:51:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cc6d8a2e-c23d-47a6-9e4b-2cdf27c831f3 req-57a7edd6-cd8e-41ae-ad43-c17fd6e0e35d tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:51:05 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f19ee31-02b5-4a50-8f69-de2c9ad83c46]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:51:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cc6d8a2e-c23d-47a6-9e4b-2cdf27c831f3 req-57a7edd6-cd8e-41ae-ad43-c17fd6e0e35d tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:51:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-cc6d8a2e-c23d-47a6-9e4b-2cdf27c831f3 req-57a7edd6-cd8e-41ae-ad43-c17fd6e0e35d tempest-AttachVolumeTestJSON-1035035170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52" returned: 0 in 0.439s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:51:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-cc6d8a2e-c23d-47a6-9e4b-2cdf27c831f3 req-57a7edd6-cd8e-41ae-ad43-c17fd6e0e35d tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.501s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:51:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-cc6d8a2e-c23d-47a6-9e4b-2cdf27c831f3 req-57a7edd6-cd8e-41ae-ad43-c17fd6e0e35d tempest-AttachVolumeTestJSON-1035035170 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-483a3d94-72dd-4828-8135-e7405c7d5b52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f21497bf-8256-452b-a22e-512c403c891a', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:51:06 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-cc6d8a2e-c23d-47a6-9e4b-2cdf27c831f3 req-57a7edd6-cd8e-41ae-ad43-c17fd6e0e35d tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:51:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-cc6d8a2e-c23d-47a6-9e4b-2cdf27c831f3 req-57a7edd6-cd8e-41ae-ad43-c17fd6e0e35d tempest-AttachVolumeTestJSON-1035035170 None] attachment_update completed successfully.
Sep 18 13:51:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:51:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:51:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:51:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:51:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:51:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:51:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:51:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.179s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:51:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:51:14 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:51:14 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:51:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Flow 'volume_create_manager' (85eace83-eb31-446f-b1b2-79d99cf09dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:51:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7c83c7-4bf4-4f01-a640-24c3cd3e2471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7c83c7-4bf4-4f01-a640-24c3cd3e2471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-546471444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3693a0b3-3860-485d-b8ae-11cf8a6abd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b28fd393a314010977f43f20e53f328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:51:15Z,use_quota=True,user_id='0efec3c24758429f9391a38d43a55269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8760ba48-ee4a-4f2d-bd97-b657bf1bcc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8760ba48-ee4a-4f2d-bd97-b657bf1bcc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbbc101-1d2a-4223-a9c8-b409f32e9393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbbc101-1d2a-4223-a9c8-b409f32e9393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3693a0b3-3860-485d-b8ae-11cf8a6abd2f', 'volume_name': 'volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c628c9d-c682-466e-a6fb-3bc7a48927eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c628c9d-c682-466e-a6fb-3bc7a48927eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033bda5d-2246-42f7-9cc5-a91448e4f5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:51:15 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Volume 3693a0b3-3860-485d-b8ae-11cf8a6abd2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f', 'volume_size': 1}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-546471444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3693a0b3-3860-485d-b8ae-11cf8a6abd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b28fd393a314010977f43f20e53f328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:51:15Z,use_quota=True,user_id='0efec3c24758429f9391a38d43a55269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Creating volume 3693a0b3-3860-485d-b8ae-11cf8a6abd2f {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:51:15 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:51:15 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=98, name=volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f 1073741824" returned: 0 in 0.338s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f" returned: 0 in 0.101s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] <== create_volume: return (538ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.558s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033bda5d-2246-42f7-9cc5-a91448e4f5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be47e57-6e09-4190-b811-0d0080f05312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:51:15 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Volume volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f (3693a0b3-3860-485d-b8ae-11cf8a6abd2f): created successfully
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be47e57-6e09-4190-b811-0d0080f05312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:51:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Flow 'volume_create_manager' (85eace83-eb31-446f-b1b2-79d99cf09dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:51:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9f60ed96-0481-4e27-bacc-93b360ab4702 tempest-AttachVolumeTestJSON-1035035170 None] Created volume successfully.
Sep 18 13:51:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-505dfb81-beb1-4f3b-ad3c-9b663a6cb30e req-00af332b-e24c-4fdf-984f-9deba6d9093e tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:51:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-505dfb81-beb1-4f3b-ad3c-9b663a6cb30e req-00af332b-e24c-4fdf-984f-9deba6d9093e tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:51:20 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ec670f-10cc-4576-85c9-5e29c8138569]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:51:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-505dfb81-beb1-4f3b-ad3c-9b663a6cb30e req-00af332b-e24c-4fdf-984f-9deba6d9093e tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:51:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-505dfb81-beb1-4f3b-ad3c-9b663a6cb30e req-00af332b-e24c-4fdf-984f-9deba6d9093e tempest-AttachVolumeTestJSON-1035035170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f" returned: 0 in 0.717s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:51:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-505dfb81-beb1-4f3b-ad3c-9b663a6cb30e req-00af332b-e24c-4fdf-984f-9deba6d9093e tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:51:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-505dfb81-beb1-4f3b-ad3c-9b663a6cb30e req-00af332b-e24c-4fdf-984f-9deba6d9093e tempest-AttachVolumeTestJSON-1035035170 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bccc4e2-c63a-4277-afab-5556460e3978', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:51:22 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-505dfb81-beb1-4f3b-ad3c-9b663a6cb30e req-00af332b-e24c-4fdf-984f-9deba6d9093e tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:51:22 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-505dfb81-beb1-4f3b-ad3c-9b663a6cb30e req-00af332b-e24c-4fdf-984f-9deba6d9093e tempest-AttachVolumeTestJSON-1035035170 None] attachment_update completed successfully.
Sep 18 13:51:32 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=15,cinder:UPDATE=15,cinder:INSERT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:51:32 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=24,cinder:UPDATE=16,cinder:DELETE=3,cinder:INSERT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:51:53 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-72c294f9-daa6-4ff5-9be5-78514dc9383e req-049d9639-8034-4937-b173-fa48b80162c8 tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:51:53 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-72c294f9-daa6-4ff5-9be5-78514dc9383e req-049d9639-8034-4937-b173-fa48b80162c8 tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:51:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-72c294f9-daa6-4ff5-9be5-78514dc9383e req-049d9639-8034-4937-b173-fa48b80162c8 tempest-AttachVolumeTestJSON-1035035170 None] Terminate volume connection completed successfully.
Sep 18 13:51:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-72c294f9-daa6-4ff5-9be5-78514dc9383e req-049d9639-8034-4937-b173-fa48b80162c8 tempest-AttachVolumeTestJSON-1035035170 None] Deleting attachment f21497bf-8256-452b-a22e-512c403c891a. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:52:03 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:52:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:52:05 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:52:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Flow 'volume_create_manager' (eff4d1bf-464c-4872-bd83-9488e1d8cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:52:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc41ac2-b5fe-4fb3-a3ad-baf33cafa777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc41ac2-b5fe-4fb3-a3ad-baf33cafa777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1383310611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6731347f-417c-4145-8c88-8f02de18b091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcf396174084036b9383115bf9ce296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:52:06Z,use_quota=True,user_id='0b46aebe64ae4c8c8d3e50eb66918acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b414080-31c5-4235-add4-e1bad438d1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b414080-31c5-4235-add4-e1bad438d1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2743cbb0-9431-4479-afd4-7b9d5714e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:05 devstack cinder-volume[82799]: DEBUG cinder.image.glance [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Creating Keystone auth plugin from conf {{(pid=82799) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 13:52:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2743cbb0-9431-4479-afd4-7b9d5714e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6731347f-417c-4145-8c88-8f02de18b091', 'volume_name': 'volume-6731347f-417c-4145-8c88-8f02de18b091', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e9681f010>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2349ca71-64d1-4f49-9e2b-a77e120035b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2349ca71-64d1-4f49-9e2b-a77e120035b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715ac26b-ef2e-4a43-9d31-29a347c6d26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:06 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Volume 6731347f-417c-4145-8c88-8f02de18b091: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6731347f-417c-4145-8c88-8f02de18b091', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e9681f010>}
Sep 18 13:52:06 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Cloning 6731347f-417c-4145-8c88-8f02de18b091 from image bcfddd9f-68c0-4f36-86c6-1809e131a4ca  at location (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]). {{(pid=82799) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 13:52:06 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 13:52:06 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 13:52:06 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb84e9e9-71d0-4192-82ec-f22fb5794795]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:07 devstack sudo[97347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD
Sep 18 13:52:07 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:52:08 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root
Sep 18 13:52:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD" returned: 0 in 2.201s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:08 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Temporary image bcfddd9f-68c0-4f36-86c6-1809e131a4ca is fetched for user 0b46aebe64ae4c8c8d3e50eb66918acc. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 13:52:09 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec4111e-c2d3-4d27-8feb-f1443fc1aa68]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:09 devstack sudo[97352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD
Sep 18 13:52:09 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:52:11 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD" returned: 0 in 2.046s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1383310611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6731347f-417c-4145-8c88-8f02de18b091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcf396174084036b9383115bf9ce296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:52:06Z,use_quota=True,user_id='0b46aebe64ae4c8c8d3e50eb66918acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Creating volume 6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:52:11 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:11 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=99, name=volume-6731347f-417c-4145-8c88-8f02de18b091, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 1073741824" returned: 0 in 0.390s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 0 in 0.090s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] <== create_volume: return (579ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:52:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.618s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Attempting download of bcfddd9f-68c0-4f36-86c6-1809e131a4ca ((None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}])) to volume 6731347f-417c-4145-8c88-8f02de18b091. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[967f3238-c42a-4deb-9a88-22339dd6d7ad]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_781rbwor {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_781rbwor" returned: 0 in 0.363s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_781rbwor {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.110s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:52:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_781rbwor" returned: 1 in 0.500s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_781rbwor' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:52:13 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[42723a01-357c-4cb3-a118-191b12296531]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:13 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] bcfddd9f-68c0-4f36-86c6-1809e131a4ca was qcow2, converting to raw {{(pid=82799) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 13:52:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:13 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=99, name=volume-6731347f-417c-4145-8c88-8f02de18b091, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:52:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 0 in 1.092s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:14 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bcfddd9f-68c0-4f36-86c6-1809e131a4ca_qumyknpkdevstack@QuobyteHD, size 112.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:52:14 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Converted 112.00 MB image at 100.23 MB/s
Sep 18 13:52:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 1G" returned: 0 in 0.157s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a6f3d-535a-4c09-bb3e-681570f90475]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 0 in 0.352s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 1 in 0.365s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Downloaded image bcfddd9f-68c0-4f36-86c6-1809e131a4ca ((None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}])) to volume 6731347f-417c-4145-8c88-8f02de18b091 successfully. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Temporary image bcfddd9f-68c0-4f36-86c6-1809e131a4ca for user 0b46aebe64ae4c8c8d3e50eb66918acc is deleted. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Marking volume 6731347f-417c-4145-8c88-8f02de18b091 as bootable. {{(pid=82799) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Copying metadata from image bcfddd9f-68c0-4f36-86c6-1809e131a4ca to 6731347f-417c-4145-8c88-8f02de18b091. {{(pid=82799) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 13:52:15 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Creating volume glance metadata for volume 6731347f-417c-4145-8c88-8f02de18b091 backed by image bcfddd9f-68c0-4f36-86c6-1809e131a4ca with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82799) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 13:52:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715ac26b-ef2e-4a43-9d31-29a347c6d26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6731347f-417c-4145-8c88-8f02de18b091', 'volume_size': 1, 'image_id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd82b29d283c34289a5aee775ea8b2228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bcfddd9f-68c0-4f36-86c6-1809e131a4ca', 'created_at': datetime.datetime(2025, 9, 18, 11, 12, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcfddd9f-68c0-4f36-86c6-1809e131a4ca/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e9681f010>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac2973f-8238-45fc-a5fd-2991d55ea1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:16 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Volume volume-6731347f-417c-4145-8c88-8f02de18b091 (6731347f-417c-4145-8c88-8f02de18b091): created successfully
Sep 18 13:52:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac2973f-8238-45fc-a5fd-2991d55ea1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Flow 'volume_create_manager' (eff4d1bf-464c-4872-bd83-9488e1d8cd61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:52:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-65c0aecf-d4e4-426a-aa93-b6a44585eb93 tempest-TestShelveInstance-1812214623 None] Created volume successfully.
Sep 18 13:52:17 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-3071fd75-b3c9-4926-a57e-1d505145729d req-0919fe9b-99f3-4ed7-8f65-47c78268896a tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:52:17 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-3071fd75-b3c9-4926-a57e-1d505145729d req-0919fe9b-99f3-4ed7-8f65-47c78268896a tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:52:17 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-3071fd75-b3c9-4926-a57e-1d505145729d req-0919fe9b-99f3-4ed7-8f65-47c78268896a tempest-AttachVolumeTestJSON-1035035170 None] Terminate volume connection completed successfully.
Sep 18 13:52:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-3071fd75-b3c9-4926-a57e-1d505145729d req-0919fe9b-99f3-4ed7-8f65-47c78268896a tempest-AttachVolumeTestJSON-1035035170 None] Deleting attachment 5bccc4e2-c63a-4277-afab-5556460e3978. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:52:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:26 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4897fe-79e9-469c-9e19-775c7c027e58]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=2,cinder:SELECT=7,cinder:INSERT=9 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:52:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 0 in 0.685s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 1 in 0.573s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:52:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.399s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-6731347f-417c-4145-8c88-8f02de18b091', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f4d3e51-f40c-4341-8f24-7d29f6f1a163', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:52:28 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:52:28 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-0a4ba782-4370-4b8e-a104-ad4b692d988d req-283bfa34-29f4-4782-a849-c2ac6b999e44 tempest-TestShelveInstance-1812214623 None] attachment_update completed successfully.
Sep 18 13:52:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "cinder-3693a0b3-3860-485d-b8ae-11cf8a6abd2f-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:52:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-3693a0b3-3860-485d-b8ae-11cf8a6abd2f-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:52:32 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:52:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "cinder-quobyte-3693a0b3-3860-485d-b8ae-11cf8a6abd2f" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:52:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-quobyte-3693a0b3-3860-485d-b8ae-11cf8a6abd2f" acquired by "delete_volume" :: waited 0.020s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:52:32 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f230fc24-9978-4b78-8319-a21dd3f0e6e1]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f" returned: 0 in 0.448s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3693a0b3-3860-485d-b8ae-11cf8a6abd2f" returned: 0 in 0.106s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-quobyte-3693a0b3-3860-485d-b8ae-11cf8a6abd2f" released by "delete_volume" :: held 0.760s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Created reservations ['2c0e1415-8583-41d5-97d5-b87930daa77f', '3327afb2-982f-41ea-b6d0-7639aedb8772', '5bd4bd86-5eff-4b16-9777-6acca1d23dc0', 'b6057df1-09e5-4c05-bd09-90a549294ed3'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.087s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:33 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:52:33 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Deleted volume successfully.
Sep 18 13:52:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-86f10407-e60f-4f84-a7e3-c479daebf149 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-3693a0b3-3860-485d-b8ae-11cf8a6abd2f-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:52:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "cinder-483a3d94-72dd-4828-8135-e7405c7d5b52-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:52:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-483a3d94-72dd-4828-8135-e7405c7d5b52-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:52:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:52:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "cinder-quobyte-483a3d94-72dd-4828-8135-e7405c7d5b52" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:52:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-quobyte-483a3d94-72dd-4828-8135-e7405c7d5b52" acquired by "delete_volume" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:52:34 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[5605f068-5971-458c-95ae-05f1948c6aa8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52" returned: 0 in 0.406s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-483a3d94-72dd-4828-8135-e7405c7d5b52" returned: 0 in 0.126s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-quobyte-483a3d94-72dd-4828-8135-e7405c7d5b52" released by "delete_volume" :: held 0.735s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:52:35 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Created reservations ['bf1a7ffc-2ca6-4d76-9f05-36a167178d4c', 'b43cff91-d0c2-4e19-bfeb-9c4586f0d430', '41c1ba1e-4a9b-48d0-989a-6bb6df6dcc03', 'fc40b88d-ac22-4116-bee0-183f2a862d0d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:52:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:52:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:52:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.117s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:36 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:52:36 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Deleted volume successfully.
Sep 18 13:52:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7790e608-8d96-4a86-87b2-0ac8fdf59ac8 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-483a3d94-72dd-4828-8135-e7405c7d5b52-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:52:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "cinder-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:52:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:52:37 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:52:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "cinder-quobyte-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:52:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-quobyte-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c" acquired by "delete_volume" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:52:37 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf579c7-4c6f-4135-90b7-5a57e13defbc]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c" returned: 0 in 0.476s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c" returned: 0 in 0.097s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-quobyte-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c" released by "delete_volume" :: held 0.758s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:52:38 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Created reservations ['8783507c-d2ae-4532-94ae-fc3224084b1d', '68e4c764-7d65-4f2f-97d0-1b6e3837cdba', '94ced069-bd81-43db-acff-6247569fa868', '68f24451-0db7-4c61-84b7-62d429d53682'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:52:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:52:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:52:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.093s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.376s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:40 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:52:40 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Deleted volume successfully.
Sep 18 13:52:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ea9816e2-18e9-48d6-88de-15f82d3f60b5 tempest-AttachVolumeTestJSON-1035035170 None] Lock "cinder-bdaa6c8a-e49f-4cdd-b780-caae0a925a8c-delete_volume" released by "delete_volume" :: held 4.150s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:52:48 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:52:51 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=30,cinder:UPDATE=28,cinder:INSERT=10,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:52:52 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:52:52 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:52:52 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Flow 'volume_create_manager' (745a90b9-d25b-4ca0-90db-1c74f861a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954b56ac-9c3f-4da4-b3e6-2ce5d0a0a8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954b56ac-9c3f-4da4-b3e6-2ce5d0a0a8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-42595873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9bbd34-54c7-4035-93af-c294daf2bfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb688145032f4d04bcd8e9dab07e5991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:52:53Z,use_quota=True,user_id='b1d04cdd5bf14075a37f48c48e4097e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8acc05-33c8-4efa-af02-c597c9d90935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8acc05-33c8-4efa-af02-c597c9d90935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080401bb-084a-481e-87f0-4c0e6b754943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080401bb-084a-481e-87f0-4c0e6b754943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9bbd34-54c7-4035-93af-c294daf2bfaf', 'volume_name': 'volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3665085d-0c9a-42ad-b2d4-819d29c8628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3665085d-0c9a-42ad-b2d4-819d29c8628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e638711-130b-460d-8019-b420b763d033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:53 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Volume 4c9bbd34-54c7-4035-93af-c294daf2bfaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf', 'volume_size': 1}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-42595873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9bbd34-54c7-4035-93af-c294daf2bfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb688145032f4d04bcd8e9dab07e5991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:52:53Z,use_quota=True,user_id='b1d04cdd5bf14075a37f48c48e4097e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Creating volume 4c9bbd34-54c7-4035-93af-c294daf2bfaf {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:52:53 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:53 devstack quobyte-client[82822]: System call of process 97986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:52:53 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=100, name=volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:52:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf 1073741824" returned: 0 in 0.670s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf" returned: 0 in 0.153s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] <== create_volume: return (973ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:52:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e638711-130b-460d-8019-b420b763d033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6bfae1-820c-4b58-869e-d3369faa84cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:52:54 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Volume volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf (4c9bbd34-54c7-4035-93af-c294daf2bfaf): created successfully
Sep 18 13:52:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6bfae1-820c-4b58-869e-d3369faa84cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:52:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Flow 'volume_create_manager' (745a90b9-d25b-4ca0-90db-1c74f861a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:52:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-b79df95e-a42b-43aa-b87d-5a4856b4bd5d req-ee332ab0-d48e-4b14-9fa8-082368ff5926 tempest-VolumesSnapshotsTestJSON-1698982471 None] Created volume successfully.
Sep 18 13:52:56 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:52:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:52:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:52:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Creating offline snapshot b5d36841-c39f-4d38-8264-bff8531cf7cb of volume 4c9bbd34-54c7-4035-93af-c294daf2bfaf {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:52:56 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[716fffc8-644f-4247-808d-20dc41cd5ad3]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:52:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:56 devstack quobyte-client[82822]: System call of process 97991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:52:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf" returned: 0 in 0.685s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:57 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=101, name=volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:52:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb 1G" returned: 0 in 0.419s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:57 devstack quobyte-client[82822]: System call of process 97997 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:52:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "qemu-img rebase -u -b volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb" returned: 0 in 0.218s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:52:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb" returned: 0 in 0.138s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:52:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb" returned: 0 in 0.136s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.info" returned: 0 in 0.165s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:52:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:52:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.info" returned: 0 in 0.201s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:52:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:52:58 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-7c36c775-1c3f-43cf-be45-15e465bcbaaa req-45d08a89-8b4c-4adc-863a-9bb9106e71ee tempest-VolumesSnapshotsTestJSON-1698982471 None] Create snapshot completed successfully
Sep 18 13:52:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Acquiring lock "cinder-b5d36841-c39f-4d38-8264-bff8531cf7cb-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-b5d36841-c39f-4d38-8264-bff8531cf7cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.102s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Acquiring lock "cinder-quobyte-4c9bbd34-54c7-4035-93af-c294daf2bfaf" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-quobyte-4c9bbd34-54c7-4035-93af-c294daf2bfaf" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Acquiring lock "cinder-quobyte-b5d36841-c39f-4d38-8264-bff8531cf7cb" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-quobyte-b5d36841-c39f-4d38-8264-bff8531cf7cb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Deleting offline snapshot b5d36841-c39f-4d38-8264-bff8531cf7cb of volume 4c9bbd34-54c7-4035-93af-c294daf2bfaf {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] snapshot_file for this snap is: volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de66a81-29ea-4510-88d3-9234ed5945e6]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb" returned: 0 in 0.432s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c08a0e8-72f0-43fa-9a3f-daf453c19b65]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf" returned: 0 in 0.501s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb" returned: 0 in 0.211s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf.b5d36841-c39f-4d38-8264-bff8531cf7cb" returned: 0 in 0.101s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-quobyte-b5d36841-c39f-4d38-8264-bff8531cf7cb" released by "_delete_snapshot" :: held 1.592s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-quobyte-4c9bbd34-54c7-4035-93af-c294daf2bfaf" released by "delete_snapshot" :: held 1.621s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:02 devstack cinder-volume[82799]: DEBUG cinder.quota [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Created reservations ['b5503bb9-e76c-4aaf-be3a-9dd55e2f0f1b', '8408ae66-e9c2-452a-a760-f575e5cf3cdb', '2065bc33-9a8a-4c3a-94b3-a2ec85a6c596', '621f0281-fc1b-435e-b03c-d936af533f90'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:53:02 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Delete snapshot completed successfully.
Sep 18 13:53:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-31e85700-9450-4f35-a3d2-4f3afee21d28 req-3ac3e3b8-519d-4967-8e5a-a76e0a0bd3e9 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-b5d36841-c39f-4d38-8264-bff8531cf7cb-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Acquiring lock "cinder-4c9bbd34-54c7-4035-93af-c294daf2bfaf-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-4c9bbd34-54c7-4035-93af-c294daf2bfaf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Acquiring lock "cinder-quobyte-4c9bbd34-54c7-4035-93af-c294daf2bfaf" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-quobyte-4c9bbd34-54c7-4035-93af-c294daf2bfaf" acquired by "delete_volume" :: waited 0.017s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:02 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcdd726-5b9a-4b60-9b9f-a8803a085318]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf" returned: 0 in 0.406s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4c9bbd34-54c7-4035-93af-c294daf2bfaf" returned: 0 in 0.104s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-quobyte-4c9bbd34-54c7-4035-93af-c294daf2bfaf" released by "delete_volume" :: held 0.710s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG cinder.quota [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Created reservations ['c63c6875-eca3-42d0-a162-7da2679fbeff', 'd9339970-361d-4bea-8f72-6061da643160', '66c7a988-5b90-4f9e-9d42-e2f06d38aee0', 'c10aa155-814e-40e5-a642-3142b9a69b21'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.121s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:03 devstack cinder-volume[82799]: DEBUG cinder.manager [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:53:04 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Deleted volume successfully.
Sep 18 13:53:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-3ae21b20-66fe-404f-9cc2-106b30e8c077 req-4922d37a-15c7-4205-a9c2-5cf0c362d6d7 tempest-VolumesSnapshotsTestJSON-1698982471 None] Lock "cinder-4c9bbd34-54c7-4035-93af-c294daf2bfaf-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:08 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:08 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Flow 'volume_create_manager' (db33e038-75b0-4b81-848f-7f956c0d1ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c31c7f6-f05e-4fe8-bfa4-2488dcebf1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c31c7f6-f05e-4fe8-bfa4-2488dcebf1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1763180067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee215a1-6a18-4c63-83f9-a921d7e49fb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2e0c8f65e1d4a75af40816dfe3e0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:53:09Z,use_quota=True,user_id='ad8db7d9ad1745669ea241422eb73775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9b80a5-4a01-486b-8cb7-2156db1cd54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9b80a5-4a01-486b-8cb7-2156db1cd54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a39eec0-de63-48c9-91a5-29ce04799a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a39eec0-de63-48c9-91a5-29ce04799a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee215a1-6a18-4c63-83f9-a921d7e49fb5', 'volume_name': 'volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f574ed2e-b328-4e55-be8d-25c985a937b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f574ed2e-b328-4e55-be8d-25c985a937b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e90cc89-63af-4b47-b8ab-e90578642d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:09 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Volume bee215a1-6a18-4c63-83f9-a921d7e49fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5', 'volume_size': 1}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1763180067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee215a1-6a18-4c63-83f9-a921d7e49fb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2e0c8f65e1d4a75af40816dfe3e0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:53:09Z,use_quota=True,user_id='ad8db7d9ad1745669ea241422eb73775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Creating volume bee215a1-6a18-4c63-83f9-a921d7e49fb5 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:53:09 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:09 devstack quobyte-client[82822]: System call of process 98026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:53:09 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=103, name=volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5 1073741824" returned: 0 in 0.437s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5" returned: 0 in 0.138s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] <== create_volume: return (655ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:53:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e90cc89-63af-4b47-b8ab-e90578642d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ed3ecf-1a70-4aea-be39-676a41fb294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:10 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Volume volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5 (bee215a1-6a18-4c63-83f9-a921d7e49fb5): created successfully
Sep 18 13:53:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ed3ecf-1a70-4aea-be39-676a41fb294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Flow 'volume_create_manager' (db33e038-75b0-4b81-848f-7f956c0d1ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:53:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-37218ce4-e47d-4722-86f3-fa6e02348269 tempest-VolumesTestJSON-371088874 None] Created volume successfully.
Sep 18 13:53:11 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Flow 'volume_create_manager' (051aa6a5-83f5-425a-8d76-009a87d5fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85acda12-9f9c-45f1-bd36-cf3b0bd364ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85acda12-9f9c-45f1-bd36-cf3b0bd364ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-979387906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576eb804-b8e0-440c-bee8-7efd9fb1a1b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2e0c8f65e1d4a75af40816dfe3e0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:53:12Z,use_quota=True,user_id='ad8db7d9ad1745669ea241422eb73775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45af00cb-468c-4985-ad86-0e2935d426d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45af00cb-468c-4985-ad86-0e2935d426d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e236fac-cf0e-4b46-9ddd-3706eefa8832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e236fac-cf0e-4b46-9ddd-3706eefa8832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576eb804-b8e0-440c-bee8-7efd9fb1a1b2', 'volume_name': 'volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a871e657-7216-4a35-8565-9863500243d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a871e657-7216-4a35-8565-9863500243d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe08e6a-02e9-43ee-abba-1902f195ebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Volume 576eb804-b8e0-440c-bee8-7efd9fb1a1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2', 'volume_size': 1}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-979387906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576eb804-b8e0-440c-bee8-7efd9fb1a1b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2e0c8f65e1d4a75af40816dfe3e0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:53:12Z,use_quota=True,user_id='ad8db7d9ad1745669ea241422eb73775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Creating volume 576eb804-b8e0-440c-bee8-7efd9fb1a1b2 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:53:11 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:53:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:12 devstack quobyte-client[82822]: System call of process 98031 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:53:12 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=104, name=volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2 1073741824" returned: 0 in 0.382s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2" returned: 0 in 0.091s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] <== create_volume: return (538ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.551s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe08e6a-02e9-43ee-abba-1902f195ebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403ae5db-4942-4063-98dc-8985144061ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:12 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Volume volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2 (576eb804-b8e0-440c-bee8-7efd9fb1a1b2): created successfully
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403ae5db-4942-4063-98dc-8985144061ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Flow 'volume_create_manager' (051aa6a5-83f5-425a-8d76-009a87d5fee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:12 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1ff758fd-0a3f-49b9-89c7-d47e71f73a3c tempest-VolumesTestJSON-371088874 None] Created volume successfully.
Sep 18 13:53:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.236s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:53:14 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Flow 'volume_create_manager' (b1f75c52-db7a-4803-8bb1-d1e156d38c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa69467-129e-4458-a4c7-2941be853100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa69467-129e-4458-a4c7-2941be853100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1252914708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f362da-09a3-4cd1-901e-1cd7ddc4ddb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2e0c8f65e1d4a75af40816dfe3e0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:53:14Z,use_quota=True,user_id='ad8db7d9ad1745669ea241422eb73775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d821d7-f1b8-4725-b0a1-986e7accff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d821d7-f1b8-4725-b0a1-986e7accff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a272d4a7-f5dd-47e7-a093-aa5707b56043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a272d4a7-f5dd-47e7-a093-aa5707b56043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f362da-09a3-4cd1-901e-1cd7ddc4ddb0', 'volume_name': 'volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3484023-b2ac-476b-8a37-814d11c02468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3484023-b2ac-476b-8a37-814d11c02468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bc2d76-55da-40ae-9a24-eaff1f7cd681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:14 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Volume 90f362da-09a3-4cd1-901e-1cd7ddc4ddb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0', 'volume_size': 1}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1252914708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f362da-09a3-4cd1-901e-1cd7ddc4ddb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2e0c8f65e1d4a75af40816dfe3e0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:53:14Z,use_quota=True,user_id='ad8db7d9ad1745669ea241422eb73775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Creating volume 90f362da-09a3-4cd1-901e-1cd7ddc4ddb0 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:53:14 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:14 devstack quobyte-client[82822]: System call of process 98037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:53:14 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=105, name=volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0 1073741824" returned: 0 in 0.357s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0" returned: 0 in 0.090s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] <== create_volume: return (514ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:53:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.527s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bc2d76-55da-40ae-9a24-eaff1f7cd681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133cc3d1-8984-4a57-a344-175e3b6b5f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:15 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Volume volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0 (90f362da-09a3-4cd1-901e-1cd7ddc4ddb0): created successfully
Sep 18 13:53:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133cc3d1-8984-4a57-a344-175e3b6b5f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Flow 'volume_create_manager' (b1f75c52-db7a-4803-8bb1-d1e156d38c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:53:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3eadc8c7-f4bf-4fc1-87e0-c611aa8c647c tempest-VolumesTestJSON-371088874 None] Created volume successfully.
Sep 18 13:53:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Acquiring lock "cinder-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Lock "cinder-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:17 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Acquiring lock "cinder-quobyte-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Lock "cinder-quobyte-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0" acquired by "delete_volume" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:17 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0123518-7322-4b5f-aef3-49026f7857ce]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0" returned: 0 in 0.564s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0" returned: 0 in 0.149s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Lock "cinder-quobyte-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0" released by "delete_volume" :: held 0.907s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Created reservations ['af27bd8d-f213-45f5-ba41-eabb058b6f9d', '54b3b65e-dbe4-461d-a4c0-2b5d51d6b193', '16497f8a-d178-4437-8b21-1db3aa2d2385', '2a78f0d6-cc68-4bf7-9a89-813573d2278c'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.090s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:53:19 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Deleted volume successfully.
Sep 18 13:53:19 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-37cb95ed-8ee4-413f-863c-8ef490196958 tempest-VolumesTestJSON-371088874 None] Lock "cinder-90f362da-09a3-4cd1-901e-1cd7ddc4ddb0-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Acquiring lock "cinder-576eb804-b8e0-440c-bee8-7efd9fb1a1b2-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Lock "cinder-576eb804-b8e0-440c-bee8-7efd9fb1a1b2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:20 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Acquiring lock "cinder-quobyte-576eb804-b8e0-440c-bee8-7efd9fb1a1b2" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Lock "cinder-quobyte-576eb804-b8e0-440c-bee8-7efd9fb1a1b2" acquired by "delete_volume" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64b0662-c1e7-4757-bceb-e267b6179927]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2" returned: 0 in 0.420s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-576eb804-b8e0-440c-bee8-7efd9fb1a1b2" returned: 0 in 0.096s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Lock "cinder-quobyte-576eb804-b8e0-440c-bee8-7efd9fb1a1b2" released by "delete_volume" :: held 0.690s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Created reservations ['b86f9f20-5d23-4a09-8865-11de66749acc', '6036319c-3371-4917-a986-c382a7b59c78', '24792793-6428-4bf0-b5d9-ff3f9c3ec5e0', '9d709ee8-9c8e-4a05-8396-3e5a8795bdb3'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.094s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:53:21 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Deleted volume successfully.
Sep 18 13:53:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-87a9fae7-1ffa-48e9-8299-54bb4ce47ed7 tempest-VolumesTestJSON-371088874 None] Lock "cinder-576eb804-b8e0-440c-bee8-7efd9fb1a1b2-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Acquiring lock "cinder-bee215a1-6a18-4c63-83f9-a921d7e49fb5-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Lock "cinder-bee215a1-6a18-4c63-83f9-a921d7e49fb5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:22 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Acquiring lock "cinder-quobyte-bee215a1-6a18-4c63-83f9-a921d7e49fb5" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Lock "cinder-quobyte-bee215a1-6a18-4c63-83f9-a921d7e49fb5" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:22 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced5039d-9630-497b-8e68-e6143cbbfd9c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5" returned: 0 in 0.445s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bee215a1-6a18-4c63-83f9-a921d7e49fb5" returned: 0 in 0.097s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Lock "cinder-quobyte-bee215a1-6a18-4c63-83f9-a921d7e49fb5" released by "delete_volume" :: held 0.723s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Created reservations ['820ea7e1-1142-4375-abd8-2967ef870e00', '5a01797c-9dc2-46a5-9f3c-08edf0a99ba1', '3c5938d4-ebb0-4b12-a442-81f8a72f1166', 'dc591a70-c86e-49b9-932e-0e7312a6a4af'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.100s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:23 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:53:24 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Deleted volume successfully.
Sep 18 13:53:24 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0ee62c76-43a9-41a6-8010-d6881977fc99 tempest-VolumesTestJSON-371088874 None] Lock "cinder-bee215a1-6a18-4c63-83f9-a921d7e49fb5-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:33 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=48,cinder:DELETE=7,cinder:SELECT=30,cinder:INSERT=7 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:53:34 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=31,cinder:UPDATE=46,cinder:INSERT=13,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:53:39 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Flow 'volume_create_manager' (c9395429-6db7-488b-8ca8-25b483377666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a2f50f-1a7a-4cd1-ba1d-d9059103421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a2f50f-1a7a-4cd1-ba1d-d9059103421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1903760504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd439f28-dc6a-4565-9b86-402f2475cdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e985d2697a214d6c886215031f21a90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:53:39Z,use_quota=True,user_id='45889ed7c254401ea6d7c5297977b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce4b349-3331-4c0c-b07e-18ea18d1c21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce4b349-3331-4c0c-b07e-18ea18d1c21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299b9f80-6dcc-4316-b43d-230a6116a9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299b9f80-6dcc-4316-b43d-230a6116a9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd439f28-dc6a-4565-9b86-402f2475cdfe', 'volume_name': 'volume-bd439f28-dc6a-4565-9b86-402f2475cdfe', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cd1e1c-4bd6-4c6a-ae0e-f0a4d41b2666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cd1e1c-4bd6-4c6a-ae0e-f0a4d41b2666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3603151d-3c28-4783-a583-48f0d86410bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:39 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Volume bd439f28-dc6a-4565-9b86-402f2475cdfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd439f28-dc6a-4565-9b86-402f2475cdfe', 'volume_size': 1}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1903760504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd439f28-dc6a-4565-9b86-402f2475cdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e985d2697a214d6c886215031f21a90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:53:39Z,use_quota=True,user_id='45889ed7c254401ea6d7c5297977b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Creating volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:53:39 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:39 devstack quobyte-client[82822]: System call of process 98087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:53:39 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=106, name=volume-bd439f28-dc6a-4565-9b86-402f2475cdfe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe 1073741824" returned: 0 in 0.363s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe" returned: 0 in 0.115s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] <== create_volume: return (548ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:53:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.560s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3603151d-3c28-4783-a583-48f0d86410bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd439f28-dc6a-4565-9b86-402f2475cdfe', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad57cf1c-bd73-49a7-a82f-f92c0d06d1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:53:40 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Volume volume-bd439f28-dc6a-4565-9b86-402f2475cdfe (bd439f28-dc6a-4565-9b86-402f2475cdfe): created successfully
Sep 18 13:53:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad57cf1c-bd73-49a7-a82f-f92c0d06d1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:53:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Flow 'volume_create_manager' (c9395429-6db7-488b-8ca8-25b483377666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:53:40 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ea871a6f-d867-431e-9eb4-85301e127c66 tempest-SnapshotsActionsTest-472366230 None] Created volume successfully.
Sep 18 13:53:41 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Creating offline snapshot 372192cd-d7d2-49a5-891b-06bed709a494 of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:53:41 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[2893976c-1b31-49f5-9e57-be8b66e9964a]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe" returned: 0 in 0.767s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:42 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=107, name=volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 1G" returned: 0 in 0.225s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.166s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.093s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.092s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.info" returned: 0 in 0.085s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.info" returned: 0 in 0.087s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:44 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-00e372da-d0e9-430b-a3f5-6d474f35d318 tempest-SnapshotsActionsTest-472366230 None] Create snapshot completed successfully
Sep 18 13:53:45 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Creating offline snapshot bdc21c0d-9bf5-488c-82dc-3a2affb725ed of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:53:45 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c026db-0373-48b7-b3c6-252bf1e09575]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:46 devstack quobyte-client[82822]: System call of process 98112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:53:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.390s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:53:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:46 devstack quobyte-client[82822]: System call of process 98115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:53:46 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=109, name=volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:53:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed 1G" returned: 0 in 0.310s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed" returned: 0 in 0.164s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:53:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed" returned: 0 in 0.132s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:53:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed" returned: 0 in 0.102s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.415s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:47 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-905aca5a-bcc3-4fd3-bc23-08388a6fb865 tempest-SnapshotsActionsTest-472366230 None] Create snapshot completed successfully
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-bdc21c0d-9bf5-488c-82dc-3a2affb725ed-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-bdc21c0d-9bf5-488c-82dc-3a2affb725ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:48 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-quobyte-bdc21c0d-9bf5-488c-82dc-3a2affb725ed" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bdc21c0d-9bf5-488c-82dc-3a2affb725ed" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Deleting offline snapshot bdc21c0d-9bf5-488c-82dc-3a2affb725ed of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] snapshot_file for this snap is: volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d44c02-52c1-4c67-a55d-686fc085a2f2]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed" returned: 0 in 0.427s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd61136e-20ce-49e7-b76c-ab48ca0c4a78]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.445s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:53:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed" returned: 0 in 0.299s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.bdc21c0d-9bf5-488c-82dc-3a2affb725ed" returned: 0 in 0.115s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bdc21c0d-9bf5-488c-82dc-3a2affb725ed" released by "_delete_snapshot" :: held 1.623s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" released by "delete_snapshot" :: held 1.660s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:50 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Created reservations ['68276e00-bbd0-4f88-a49c-6d646043e7fd', '923df580-1d03-48a7-9fe5-d66a71dac28c', '14bc618c-a301-40a5-8f59-0ca0561a4609', '0d9fcfa5-34a2-4bec-8cf8-dbec6dee0a1b'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:53:50 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Delete snapshot completed successfully.
Sep 18 13:53:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf827e36-256a-443c-ac69-d18903252a1c tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-bdc21c0d-9bf5-488c-82dc-3a2affb725ed-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:52 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Creating offline snapshot 30b84135-9e3f-4044-9e04-8c2782b4b88f of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:53:52 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e555440-5b5b-4540-adfb-90e1895dac19]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:52 devstack quobyte-client[82822]: System call of process 98169 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:53:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.495s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:53:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:53 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=110, name=volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f 1G" returned: 0 in 0.321s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f" returned: 0 in 0.200s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f" returned: 0 in 0.128s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f" returned: 0 in 0.111s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.623s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:53:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-47a37cad-077e-4679-904f-f980007d93c1 tempest-SnapshotsActionsTest-472366230 None] Create snapshot completed successfully
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-30b84135-9e3f-4044-9e04-8c2782b4b88f-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-30b84135-9e3f-4044-9e04-8c2782b4b88f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:55 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-quobyte-30b84135-9e3f-4044-9e04-8c2782b4b88f" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-30b84135-9e3f-4044-9e04-8c2782b4b88f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Deleting offline snapshot 30b84135-9e3f-4044-9e04-8c2782b4b88f of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] snapshot_file for this snap is: volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9703a758-9fa8-4232-bf90-c83f2184cac4]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:56 devstack quobyte-client[82822]: System call of process 98180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:53:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f" returned: 0 in 0.559s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:53:56 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[15525c4a-919b-420c-a40c-52682631e37e]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.443s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:53:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:57 devstack quobyte-client[82822]: System call of process 98186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:53:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f" returned: 0 in 0.292s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.30b84135-9e3f-4044-9e04-8c2782b4b88f" returned: 0 in 0.165s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-30b84135-9e3f-4044-9e04-8c2782b4b88f" released by "_delete_snapshot" :: held 1.772s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" released by "delete_snapshot" :: held 1.807s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:57 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Created reservations ['b3c21213-c34d-43d0-a2e5-905aeec91566', '32e58f81-ff22-4e3d-b54c-24c17e4deeb7', '1bb186e5-4ac2-476e-b7c3-96848ad079a2', '56a669a0-fcca-4240-9d25-acb9d53c549e'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:53:57 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Delete snapshot completed successfully.
Sep 18 13:53:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e33d3a2-bd90-4abe-aa65-39d7c2f5a254 tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-30b84135-9e3f-4044-9e04-8c2782b4b88f-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:53:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:53:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:53:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:53:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Creating offline snapshot ad091e4f-ffec-4237-bbd3-ed6c2282494a of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:53:59 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d38579a-5e20-4bc0-b237-d7b22ffaeb37]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:53:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:53:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.484s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:53:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:53:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:00 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=111, name=volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a 1G" returned: 0 in 0.312s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a" returned: 0 in 0.173s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a" returned: 0 in 0.105s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a" returned: 0 in 0.084s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.439s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:01 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-783a0a91-7f0e-4ada-9fdc-9a914616f8a5 tempest-SnapshotsActionsTest-472366230 None] Create snapshot completed successfully
Sep 18 13:54:01 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-ad091e4f-ffec-4237-bbd3-ed6c2282494a-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-ad091e4f-ffec-4237-bbd3-ed6c2282494a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.236s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" acquired by "delete_snapshot" :: waited 0.050s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-quobyte-ad091e4f-ffec-4237-bbd3-ed6c2282494a" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:02 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-ad091e4f-ffec-4237-bbd3-ed6c2282494a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Deleting offline snapshot ad091e4f-ffec-4237-bbd3-ed6c2282494a of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:54:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] snapshot_file for this snap is: volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:54:02 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c743b6-3e9e-4937-922d-33a2e9bb6b72]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a" returned: 0 in 0.854s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:54:03 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c30bf75-2dc1-482d-8117-5f9493ed7ce6]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.375s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:54:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a" returned: 0 in 0.246s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.ad091e4f-ffec-4237-bbd3-ed6c2282494a" returned: 0 in 0.125s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-ad091e4f-ffec-4237-bbd3-ed6c2282494a" released by "_delete_snapshot" :: held 2.045s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" released by "delete_snapshot" :: held 2.080s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:04 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Created reservations ['2eafc4bb-486f-465e-aa18-48aabc383bf1', '433ac9c4-2678-4c71-8483-7c69959d8b73', '5ff09de3-42ff-47e0-8b07-07f1b6a0c39a', '2fca4c25-269e-4ee2-9e06-56693c70bbb4'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:54:04 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Delete snapshot completed successfully.
Sep 18 13:54:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3af291f1-676f-4243-87fe-e5055a7c53ea tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-ad091e4f-ffec-4237-bbd3-ed6c2282494a-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Creating offline snapshot 98818341-3cbd-468a-99c9-4f87ccbf1683 of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:54:05 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[01afd700-308c-44fb-8f1d-da48ac22110b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.452s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:54:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:06 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=112, name=volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:54:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 1G" returned: 0 in 0.231s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img rebase -u -b volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683" returned: 0 in 0.153s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:54:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683" returned: 0 in 0.306s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:54:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683" returned: 0 in 0.126s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.633s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:07 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3b256e93-f1a3-4558-8fd0-80760bf69086 tempest-SnapshotsActionsTest-472366230 None] Create snapshot completed successfully
Sep 18 13:54:07 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-b366ee9f-8a92-4438-85b2-678b8a834240 req-5399af8a-a61e-40ca-9d52-5c92806ece6f tempest-TestShelveInstance-1812214623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:07 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-b366ee9f-8a92-4438-85b2-678b8a834240 req-5399af8a-a61e-40ca-9d52-5c92806ece6f tempest-TestShelveInstance-1812214623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:08 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-b366ee9f-8a92-4438-85b2-678b8a834240 req-5399af8a-a61e-40ca-9d52-5c92806ece6f tempest-TestShelveInstance-1812214623 None] Terminate volume connection completed successfully.
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-b366ee9f-8a92-4438-85b2-678b8a834240 req-5399af8a-a61e-40ca-9d52-5c92806ece6f tempest-TestShelveInstance-1812214623 None] Deleting attachment 5f4d3e51-f40c-4341-8f24-7d29f6f1a163. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-98818341-3cbd-468a-99c9-4f87ccbf1683-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-98818341-3cbd-468a-99c9-4f87ccbf1683-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:08 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Acquiring lock "cinder-quobyte-98818341-3cbd-468a-99c9-4f87ccbf1683" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-98818341-3cbd-468a-99c9-4f87ccbf1683" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Deleting offline snapshot 98818341-3cbd-468a-99c9-4f87ccbf1683 of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] snapshot_file for this snap is: volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b85a3c-2a91-4629-966d-90c32d2cdfa0]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683" returned: 0 in 0.457s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[380f7485-194a-40ae-98df-903001c2d66b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.383s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:54:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683" returned: 0 in 0.216s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.98818341-3cbd-468a-99c9-4f87ccbf1683" returned: 0 in 0.082s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-98818341-3cbd-468a-99c9-4f87ccbf1683" released by "_delete_snapshot" :: held 1.428s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" released by "delete_snapshot" :: held 1.459s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:09 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Created reservations ['7fd43a98-6df2-4dde-8adb-32ee75f39840', '9d6eb760-b5c3-41d6-9fbb-8a9c5dd19097', '150d5806-f397-44e8-81fa-cbf4911c94c7', 'fe6b1ff9-3074-4567-8d9b-9ec47f8a91eb'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:54:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Delete snapshot completed successfully.
Sep 18 13:54:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b8e3981-560e-4498-9712-2a16ac325dad tempest-SnapshotsActionsTest-1281115978 None] Lock "cinder-98818341-3cbd-468a-99c9-4f87ccbf1683-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "cinder-372192cd-d7d2-49a5-891b-06bed709a494-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-372192cd-d7d2-49a5-891b-06bed709a494-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:11 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "cinder-quobyte-372192cd-d7d2-49a5-891b-06bed709a494" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-quobyte-372192cd-d7d2-49a5-891b-06bed709a494" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Deleting offline snapshot 372192cd-d7d2-49a5-891b-06bed709a494 of volume bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] snapshot_file for this snap is: volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[49799736-50ce-4707-a678-77d7805d1981]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.470s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd439f28-dc6a-4565-9b86-402f2475cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e38fd4-c895-44d8-86c7-338045e8233e]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe" returned: 0 in 0.460s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.287s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe.372192cd-d7d2-49a5-891b-06bed709a494" returned: 0 in 0.123s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-quobyte-372192cd-d7d2-49a5-891b-06bed709a494" released by "_delete_snapshot" :: held 1.559s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" released by "delete_snapshot" :: held 1.597s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.267s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:54:13 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Created reservations ['34c05960-4900-4557-b352-7916f8894459', '737a3384-badc-4d92-b3bc-fc01b83e0068', 'ad42f273-3e10-4549-8f57-ef995e17134f', 'b94f1dd2-efd4-4356-8261-b0a9b58652cb'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:54:13 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Delete snapshot completed successfully.
Sep 18 13:54:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1ce5fcce-f271-4c12-9630-e288a45c1ca1 tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-372192cd-d7d2-49a5-891b-06bed709a494-delete_snapshot" released by "delete_snapshot" :: held 2.602s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "cinder-bd439f28-dc6a-4565-9b86-402f2475cdfe-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-bd439f28-dc6a-4565-9b86-402f2475cdfe-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:14 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d507c43f-2aad-488f-936f-252ddd17cd1b]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:15 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" acquired by "delete_volume" :: waited 0.062s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c48d8dc-a6e7-4555-b70f-93db0f10497a]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 0 in 0.617s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe" returned: 0 in 0.509s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 1 in 0.457s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:54:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.327s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bd439f28-dc6a-4565-9b86-402f2475cdfe" returned: 0 in 0.314s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-quobyte-bd439f28-dc6a-4565-9b86-402f2475cdfe" released by "delete_volume" :: held 1.019s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-6731347f-417c-4145-8c88-8f02de18b091', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fcf6596-0b90-4df7-bff4-a06d1ef4ec21', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:54:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Created reservations ['0b017c78-fef3-416b-85a4-d60b82d7c37b', 'b5f0abaf-505e-4738-baa7-20d540e7e2bb', '66d3adf6-53a2-4e81-bfab-ba5e3098b1ed', '46fac789-3b70-43dc-8d1e-6074efd51c8d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:54:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-5b5eae39-c0f5-4273-a0fe-ddf03fd4e3aa req-f463a5ad-2b94-4fd2-9fa1-730adac515af tempest-TestShelveInstance-1812214623 None] attachment_update completed successfully.
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.104s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:54:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Deleted volume successfully.
Sep 18 13:54:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-794df288-35de-4f28-bb28-8bf8a942ddef tempest-SnapshotsActionsTest-472366230 None] Lock "cinder-bd439f28-dc6a-4565-9b86-402f2475cdfe-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=39,cinder:UPDATE=42,cinder:DELETE=3,cinder:INSERT=11 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:54:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=46,cinder:SELECT=46,cinder:DELETE=4,cinder:INSERT=13 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:54:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Flow 'volume_create_manager' (8682c89e-70f3-4a8c-aeed-3cf2b61ecc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922cfcf7-0272-454c-9d7f-6cd804b9ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922cfcf7-0272-454c-9d7f-6cd804b9ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-665528297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86110a41faab41d98905e03c1ef18962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:54:35Z,use_quota=True,user_id='3b1b7ea60824471495778fc6600a0dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48cad8a-2d1c-444b-8d0f-032a9bae04e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48cad8a-2d1c-444b-8d0f-032a9bae04e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe053da-b8d9-4651-b9d7-7f6f2da7bf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe053da-b8d9-4651-b9d7-7f6f2da7bf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5', 'volume_name': 'volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b4cda2-4d72-4be0-814b-30f232a9ba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b4cda2-4d72-4be0-814b-30f232a9ba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f03f91-c612-46a1-9ed8-366c9a2653b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:34 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Volume e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5', 'volume_size': 1}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-665528297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86110a41faab41d98905e03c1ef18962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:54:35Z,use_quota=True,user_id='3b1b7ea60824471495778fc6600a0dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Creating volume e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:54:35 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:35 devstack quobyte-client[82822]: System call of process 98784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:54:35 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=113, name=volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5 1073741824" returned: 0 in 0.391s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5" returned: 0 in 0.091s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] <== create_volume: return (548ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.561s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f03f91-c612-46a1-9ed8-366c9a2653b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f715ed-ff37-464f-bdc1-956a65e9380a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:35 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Volume volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5 (e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5): created successfully
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f715ed-ff37-464f-bdc1-956a65e9380a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:35 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Flow 'volume_create_manager' (8682c89e-70f3-4a8c-aeed-3cf2b61ecc3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:54:35 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-93947caf-4233-4cbd-bb9c-cfce29e735e4 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Created volume successfully.
Sep 18 13:54:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Acquiring lock "cinder-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "cinder-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:37 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Acquiring lock "cinder-quobyte-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "cinder-quobyte-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5" acquired by "delete_volume" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:37 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[73add724-8388-49ac-943a-9a29d7d1680c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5" returned: 0 in 0.621s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5" returned: 0 in 0.114s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "cinder-quobyte-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5" released by "delete_volume" :: held 0.915s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Created reservations ['eacc4054-7724-4dd6-83d5-24b81ea358d9', '65948eed-dd38-4350-be41-04223463d220', 'c282bea1-3230-4722-83ce-a1f3e37ce406', 'c3c7bd14-539a-4bbf-b9d2-0677130bad8d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.108s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:38 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:54:38 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Deleted volume successfully.
Sep 18 13:54:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cfa7ecf1-5dbe-45d1-9aeb-845c3a4e2a9f tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "cinder-e9f2095a-b4ae-41f7-89e1-78f3ce4ccae5-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:39 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:39 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:54:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Flow 'volume_create_manager' (05bb1921-0ddd-4aed-9d69-6af22d736808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:54:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf9adc5-6d8b-4a45-a28a-45a77c6a23a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf9adc5-6d8b-4a45-a28a-45a77c6a23a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1541430822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593ff7b6-e738-4728-aeb2-5274483ff409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86110a41faab41d98905e03c1ef18962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:54:40Z,use_quota=True,user_id='3b1b7ea60824471495778fc6600a0dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd28d3dc-a256-4500-9004-a03673cb4bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd28d3dc-a256-4500-9004-a03673cb4bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93466676-69c9-4117-8649-b458900b73d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93466676-69c9-4117-8649-b458900b73d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '593ff7b6-e738-4728-aeb2-5274483ff409', 'volume_name': 'volume-593ff7b6-e738-4728-aeb2-5274483ff409', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce6ceef-a879-48b6-8451-c1a82856b215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce6ceef-a879-48b6-8451-c1a82856b215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1675879f-4d15-48d5-bde2-22f3a32c3960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:40 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Volume 593ff7b6-e738-4728-aeb2-5274483ff409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-593ff7b6-e738-4728-aeb2-5274483ff409', 'volume_size': 1}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1541430822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593ff7b6-e738-4728-aeb2-5274483ff409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86110a41faab41d98905e03c1ef18962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:54:40Z,use_quota=True,user_id='3b1b7ea60824471495778fc6600a0dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Creating volume 593ff7b6-e738-4728-aeb2-5274483ff409 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:54:40 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-593ff7b6-e738-4728-aeb2-5274483ff409 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:40 devstack quobyte-client[82822]: System call of process 98793 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:54:40 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=114, name=volume-593ff7b6-e738-4728-aeb2-5274483ff409, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-593ff7b6-e738-4728-aeb2-5274483ff409 1073741824" returned: 0 in 0.436s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-593ff7b6-e738-4728-aeb2-5274483ff409 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-593ff7b6-e738-4728-aeb2-5274483ff409" returned: 0 in 0.142s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] <== create_volume: return (659ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1675879f-4d15-48d5-bde2-22f3a32c3960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-593ff7b6-e738-4728-aeb2-5274483ff409', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a65f16-18ce-41c2-8769-c21d735211d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:40 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Volume volume-593ff7b6-e738-4728-aeb2-5274483ff409 (593ff7b6-e738-4728-aeb2-5274483ff409): created successfully
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a65f16-18ce-41c2-8769-c21d735211d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Flow 'volume_create_manager' (05bb1921-0ddd-4aed-9d69-6af22d736808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:54:41 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4b10c09d-8bf7-46b8-9323-7a39fb7ff362 tempest-VolumeQuotasAdminTestJSON-1701025962 None] Created volume successfully.
Sep 18 13:54:42 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-2802b753-3985-4487-a915-5ac0c77d806f tempest-VolumeQuotasAdminTestJSON-1939123673 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-2802b753-3985-4487-a915-5ac0c77d806f tempest-VolumeQuotasAdminTestJSON-1939123673 None] Transfer volume completed successfully.
Sep 18 13:54:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Acquiring lock "cinder-593ff7b6-e738-4728-aeb2-5274483ff409-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Lock "cinder-593ff7b6-e738-4728-aeb2-5274483ff409-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:44 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:44 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Acquiring lock "cinder-quobyte-593ff7b6-e738-4728-aeb2-5274483ff409" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:54:44 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Lock "cinder-quobyte-593ff7b6-e738-4728-aeb2-5274483ff409" acquired by "delete_volume" :: waited 0.034s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:54:44 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c447e65-618a-45c3-845a-aff6b19ce1dc]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:54:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-593ff7b6-e738-4728-aeb2-5274483ff409 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:44 devstack quobyte-client[82822]: System call of process 98799 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:54:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-593ff7b6-e738-4728-aeb2-5274483ff409" returned: 0 in 0.799s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-593ff7b6-e738-4728-aeb2-5274483ff409 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-593ff7b6-e738-4728-aeb2-5274483ff409" returned: 0 in 0.096s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Lock "cinder-quobyte-593ff7b6-e738-4728-aeb2-5274483ff409" released by "delete_volume" :: held 1.119s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Created reservations ['9658d793-2938-47a3-917f-942a8468e6ae', '23e86b99-393f-476b-93c7-b3e17dee7f93', 'b2950a33-0cb7-4054-a7d7-1c54c221d006', '21e60ac9-7cf0-4c9d-8e54-606f9253c32d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.091s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:45 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:54:45 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Deleted volume successfully.
Sep 18 13:54:46 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b2ede50-3b31-413e-ac11-1ddde7b6573b tempest-VolumeQuotasAdminTestJSON-2062595814 None] Lock "cinder-593ff7b6-e738-4728-aeb2-5274483ff409-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:54:55 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=17,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=6 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:54:56 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=23,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:54:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Flow 'volume_create_manager' (ed2d1fd1-0f20-4236-b725-9b75f07fa329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158dc619-ff66-4918-9619-7c52c62720da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158dc619-ff66-4918-9619-7c52c62720da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1244955218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba5319c-2c89-42ee-852c-0ed44db6269f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dde4015c55945dfa86b683ab582e037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:54:57Z,use_quota=True,user_id='5e8f992ae353420199ccc833ce17e121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29813bc-01be-4634-b27f-cf50e4c3b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29813bc-01be-4634-b27f-cf50e4c3b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf1a928-9470-4275-9487-f06ea38254f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf1a928-9470-4275-9487-f06ea38254f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba5319c-2c89-42ee-852c-0ed44db6269f', 'volume_name': 'volume-fba5319c-2c89-42ee-852c-0ed44db6269f', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b85ab5-1c7a-46da-86da-0bbd31282743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b85ab5-1c7a-46da-86da-0bbd31282743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ef6af6-f9bc-4598-9209-dfdf8ffc3a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:57 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Volume fba5319c-2c89-42ee-852c-0ed44db6269f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba5319c-2c89-42ee-852c-0ed44db6269f', 'volume_size': 1}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1244955218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba5319c-2c89-42ee-852c-0ed44db6269f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dde4015c55945dfa86b683ab582e037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:54:57Z,use_quota=True,user_id='5e8f992ae353420199ccc833ce17e121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Creating volume fba5319c-2c89-42ee-852c-0ed44db6269f {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:54:57 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fba5319c-2c89-42ee-852c-0ed44db6269f 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:57 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=115, name=volume-fba5319c-2c89-42ee-852c-0ed44db6269f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fba5319c-2c89-42ee-852c-0ed44db6269f 1073741824" returned: 0 in 0.450s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fba5319c-2c89-42ee-852c-0ed44db6269f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fba5319c-2c89-42ee-852c-0ed44db6269f" returned: 0 in 0.124s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] <== create_volume: return (634ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:54:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.646s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:54:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ef6af6-f9bc-4598-9209-dfdf8ffc3a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba5319c-2c89-42ee-852c-0ed44db6269f', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fa5066-7b87-4f98-92a0-06a0d7499c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:58 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Volume volume-fba5319c-2c89-42ee-852c-0ed44db6269f (fba5319c-2c89-42ee-852c-0ed44db6269f): created successfully
Sep 18 13:54:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fa5066-7b87-4f98-92a0-06a0d7499c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Flow 'volume_create_manager' (ed2d1fd1-0f20-4236-b725-9b75f07fa329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:54:58 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-a07a1624-fd3b-433b-ae1c-187bbf20ae8e tempest-VolumesListAdminTestJSON-231315031 None] Created volume successfully.
Sep 18 13:54:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:54:59 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:54:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Flow 'volume_create_manager' (62390494-a4ec-4a6f-8782-89967694d117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:54:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de7609a-5910-4829-bb55-cd97a587c9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de7609a-5910-4829-bb55-cd97a587c9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1955774618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d79ec63-242a-40d6-9eac-364f220211a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dde4015c55945dfa86b683ab582e037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:00Z,use_quota=True,user_id='5e8f992ae353420199ccc833ce17e121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0d9ab7-624f-4421-95a9-61e97cec03f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0d9ab7-624f-4421-95a9-61e97cec03f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:54:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a8b6a8-5f1c-48fd-9952-f07dcb6ddbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:54:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a8b6a8-5f1c-48fd-9952-f07dcb6ddbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d79ec63-242a-40d6-9eac-364f220211a4', 'volume_name': 'volume-3d79ec63-242a-40d6-9eac-364f220211a4', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad815b11-ec40-48db-8eb5-b43bce96eb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad815b11-ec40-48db-8eb5-b43bce96eb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262cb0b7-793f-4695-b305-ec584b33bd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:00 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Volume 3d79ec63-242a-40d6-9eac-364f220211a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d79ec63-242a-40d6-9eac-364f220211a4', 'volume_size': 1}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1955774618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d79ec63-242a-40d6-9eac-364f220211a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dde4015c55945dfa86b683ab582e037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:00Z,use_quota=True,user_id='5e8f992ae353420199ccc833ce17e121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Creating volume 3d79ec63-242a-40d6-9eac-364f220211a4 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:55:00 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d79ec63-242a-40d6-9eac-364f220211a4 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:00 devstack quobyte-client[82822]: System call of process 98866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:55:00 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=116, name=volume-3d79ec63-242a-40d6-9eac-364f220211a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d79ec63-242a-40d6-9eac-364f220211a4 1073741824" returned: 0 in 0.334s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d79ec63-242a-40d6-9eac-364f220211a4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d79ec63-242a-40d6-9eac-364f220211a4" returned: 0 in 0.086s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] <== create_volume: return (496ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262cb0b7-793f-4695-b305-ec584b33bd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d79ec63-242a-40d6-9eac-364f220211a4', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d9aa7-5482-4820-9633-84352133625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:00 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Volume volume-3d79ec63-242a-40d6-9eac-364f220211a4 (3d79ec63-242a-40d6-9eac-364f220211a4): created successfully
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d9aa7-5482-4820-9633-84352133625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Flow 'volume_create_manager' (62390494-a4ec-4a6f-8782-89967694d117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:00 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7a916bf2-920a-4bc9-b0fd-706d0ef5c8bc tempest-VolumesListAdminTestJSON-231315031 None] Created volume successfully.
Sep 18 13:55:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Flow 'volume_create_manager' (c5496b5e-7e48-454b-a658-46dea3db12ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5091ad9-8266-44b5-ae7f-bb9d49f6e453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5091ad9-8266-44b5-ae7f-bb9d49f6e453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2040770587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cc0c4f-116e-4c66-80bc-74e7ca44be41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dde4015c55945dfa86b683ab582e037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:02Z,use_quota=True,user_id='5e8f992ae353420199ccc833ce17e121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af5571a-05c7-46e5-9f62-dae042c24b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af5571a-05c7-46e5-9f62-dae042c24b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffad3ce-6d5d-4a2f-b153-a303cb3a3c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffad3ce-6d5d-4a2f-b153-a303cb3a3c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39cc0c4f-116e-4c66-80bc-74e7ca44be41', 'volume_name': 'volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2813f7-b432-4616-9f39-a3378388cdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2813f7-b432-4616-9f39-a3378388cdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25160f04-043c-435e-a0b6-e306450696ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:02 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Volume 39cc0c4f-116e-4c66-80bc-74e7ca44be41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41', 'volume_size': 1}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2040770587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cc0c4f-116e-4c66-80bc-74e7ca44be41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dde4015c55945dfa86b683ab582e037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:02Z,use_quota=True,user_id='5e8f992ae353420199ccc833ce17e121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Creating volume 39cc0c4f-116e-4c66-80bc-74e7ca44be41 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:55:02 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:55:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:02 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=117, name=volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:55:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41 1073741824" returned: 0 in 0.323s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41" returned: 0 in 0.093s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] <== create_volume: return (490ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:55:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.502s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25160f04-043c-435e-a0b6-e306450696ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004343a8-1383-4976-a631-e4a833568cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:03 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Volume volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41 (39cc0c4f-116e-4c66-80bc-74e7ca44be41): created successfully
Sep 18 13:55:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004343a8-1383-4976-a631-e4a833568cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Flow 'volume_create_manager' (c5496b5e-7e48-454b-a658-46dea3db12ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:03 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-145e9d12-9bde-4169-80b7-ab4c23f27f38 tempest-VolumesListAdminTestJSON-231315031 None] Created volume successfully.
Sep 18 13:55:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Flow 'volume_create_manager' (8354aec6-f118-43f4-bd14-9b9e452fdd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c85e7fb-8241-475f-8652-8f4d44af755a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c85e7fb-8241-475f-8652-8f4d44af755a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adc673e-f665-485b-8266-b0c2a13d3dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda0dba175d148f1a6f999227b273687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:05Z,use_quota=True,user_id='654e785fe815407f99893c53a9d2d72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e59e4c-8b68-4751-b211-5dbed03f6ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e59e4c-8b68-4751-b211-5dbed03f6ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99df219-6cc1-44cb-ba0a-449152d1fa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99df219-6cc1-44cb-ba0a-449152d1fa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1adc673e-f665-485b-8266-b0c2a13d3dac', 'volume_name': 'volume-1adc673e-f665-485b-8266-b0c2a13d3dac', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af13ac64-f349-4647-8761-c59c7d8cc479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af13ac64-f349-4647-8761-c59c7d8cc479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92dbab86-e4fa-40ef-b90a-c45d17918982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:05 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Volume 1adc673e-f665-485b-8266-b0c2a13d3dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1adc673e-f665-485b-8266-b0c2a13d3dac', 'volume_size': 1}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adc673e-f665-485b-8266-b0c2a13d3dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda0dba175d148f1a6f999227b273687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:05Z,use_quota=True,user_id='654e785fe815407f99893c53a9d2d72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Creating volume 1adc673e-f665-485b-8266-b0c2a13d3dac {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:55:05 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1adc673e-f665-485b-8266-b0c2a13d3dac 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:05 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=118, name=volume-1adc673e-f665-485b-8266-b0c2a13d3dac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1adc673e-f665-485b-8266-b0c2a13d3dac 1073741824" returned: 0 in 0.343s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1adc673e-f665-485b-8266-b0c2a13d3dac {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1adc673e-f665-485b-8266-b0c2a13d3dac" returned: 0 in 0.087s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] <== create_volume: return (524ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:55:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.535s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92dbab86-e4fa-40ef-b90a-c45d17918982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adc673e-f665-485b-8266-b0c2a13d3dac', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67b1438-5651-46b1-a99f-5b9c248f281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:06 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Volume volume-1adc673e-f665-485b-8266-b0c2a13d3dac (1adc673e-f665-485b-8266-b0c2a13d3dac): created successfully
Sep 18 13:55:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67b1438-5651-46b1-a99f-5b9c248f281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Flow 'volume_create_manager' (8354aec6-f118-43f4-bd14-9b9e452fdd09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-39bf67e1-a975-4028-b29f-ac139fe6071a tempest-VolumesListAdminTestJSON-116002219 None] Created volume successfully.
Sep 18 13:55:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Acquiring lock "cinder-1adc673e-f665-485b-8266-b0c2a13d3dac-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Lock "cinder-1adc673e-f665-485b-8266-b0c2a13d3dac-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:08 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Acquiring lock "cinder-quobyte-1adc673e-f665-485b-8266-b0c2a13d3dac" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Lock "cinder-quobyte-1adc673e-f665-485b-8266-b0c2a13d3dac" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "cinder-39cc0c4f-116e-4c66-80bc-74e7ca44be41-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8225922-f2ae-469d-be19-aaf38bd29f06]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1adc673e-f665-485b-8266-b0c2a13d3dac {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-39cc0c4f-116e-4c66-80bc-74e7ca44be41-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:08 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "cinder-quobyte-39cc0c4f-116e-4c66-80bc-74e7ca44be41" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-quobyte-39cc0c4f-116e-4c66-80bc-74e7ca44be41" acquired by "delete_volume" :: waited 0.020s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66d1e01-46ac-481d-b147-ba18bef9ee59]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1adc673e-f665-485b-8266-b0c2a13d3dac" returned: 0 in 0.725s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1adc673e-f665-485b-8266-b0c2a13d3dac {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1adc673e-f665-485b-8266-b0c2a13d3dac" returned: 0 in 0.120s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Lock "cinder-quobyte-1adc673e-f665-485b-8266-b0c2a13d3dac" released by "delete_volume" :: held 1.209s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:09 devstack quobyte-client[82822]: System call of process 98894 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:55:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41" returned: 0 in 0.812s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-39cc0c4f-116e-4c66-80bc-74e7ca44be41" returned: 0 in 0.271s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-quobyte-39cc0c4f-116e-4c66-80bc-74e7ca44be41" released by "delete_volume" :: held 1.207s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:09 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Created reservations ['0cdc9fdc-30b1-49ec-99a7-95ac7d869e7f', 'f52d58aa-fcee-455c-a4ba-267b1fb1475d', 'bb240b88-33da-4c1c-af63-c6096afb4527', 'd2980137-e279-406f-9fe4-b3ca7d61fe04'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:55:09 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Created reservations ['a0ea8685-1f7b-4805-bec7-eaf5f191cd70', '1d23f688-c7f8-42a7-a6c8-4256d1a60966', 'bfb7d67c-e5c0-4f16-a875-60c7003bf212', 'f165365f-cb6c-420a-b378-f3fd8b897619'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.239s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.234s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:55:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Deleted volume successfully.
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "cinder-3d79ec63-242a-40d6-9eac-364f220211a4-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Deleted volume successfully.
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-18775202-d417-469f-a7d8-4378ff989086 tempest-VolumesListAdminTestJSON-116002219 None] Lock "cinder-1adc673e-f665-485b-8266-b0c2a13d3dac-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-3d79ec63-242a-40d6-9eac-364f220211a4-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-57f78811-b475-4c50-8883-12d03affe46b tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-39cc0c4f-116e-4c66-80bc-74e7ca44be41-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:10 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "cinder-quobyte-3d79ec63-242a-40d6-9eac-364f220211a4" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-quobyte-3d79ec63-242a-40d6-9eac-364f220211a4" acquired by "delete_volume" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:11 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68c883-510e-4e33-8321-d6a47f0ccdc2]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:55:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d79ec63-242a-40d6-9eac-364f220211a4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d79ec63-242a-40d6-9eac-364f220211a4" returned: 0 in 0.853s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d79ec63-242a-40d6-9eac-364f220211a4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d79ec63-242a-40d6-9eac-364f220211a4" returned: 0 in 0.163s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-quobyte-3d79ec63-242a-40d6-9eac-364f220211a4" released by "delete_volume" :: held 1.314s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Created reservations ['216ec9b3-9d39-4b1e-9b33-86a371b41a30', '93843e0e-03ea-4027-9129-81ec74912c13', 'b1836143-0845-4c0c-893a-4437791d5999', 'b39a2321-8f99-4d43-a491-2cbe71ecbf93'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "cinder-fba5319c-2c89-42ee-852c-0ed44db6269f-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.830s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-fba5319c-2c89-42ee-852c-0ed44db6269f-delete_volume" acquired by "delete_volume" :: waited 0.205s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:13 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "cinder-quobyte-fba5319c-2c89-42ee-852c-0ed44db6269f" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-quobyte-fba5319c-2c89-42ee-852c-0ed44db6269f" acquired by "delete_volume" :: waited 0.229s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.284s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:14 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:55:14 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5261f7f-45be-4404-a3ac-6a8c8099573a]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:55:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fba5319c-2c89-42ee-852c-0ed44db6269f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:14 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Deleted volume successfully.
Sep 18 13:55:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1671d8dc-b01f-46d6-bc1b-5039e626e202 tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-3d79ec63-242a-40d6-9eac-364f220211a4-delete_volume" released by "delete_volume" :: held 3.846s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:14 devstack quobyte-client[82822]: System call of process 99137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:55:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fba5319c-2c89-42ee-852c-0ed44db6269f" returned: 0 in 0.679s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fba5319c-2c89-42ee-852c-0ed44db6269f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fba5319c-2c89-42ee-852c-0ed44db6269f" returned: 0 in 0.106s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-quobyte-fba5319c-2c89-42ee-852c-0ed44db6269f" released by "delete_volume" :: held 1.046s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Created reservations ['c2c0ffb8-41bc-4265-86b7-9819aa9b92f4', '2e06a78b-fa19-47e8-9e10-fb7cf2438612', '9fc08a85-b34f-4561-b82a-e5851ea5a5e7', '865be745-7a7c-47df-8b90-9faca5fc9668'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.117s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:15 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:55:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Deleted volume successfully.
Sep 18 13:55:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e6f6243c-2bf9-440e-8881-45dbd55c178c tempest-VolumesListAdminTestJSON-231315031 None] Lock "cinder-fba5319c-2c89-42ee-852c-0ed44db6269f-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=21,cinder:UPDATE=36,cinder:DELETE=4,cinder:INSERT=13 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:55:26 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=28,cinder:UPDATE=45,cinder:DELETE=4,cinder:INSERT=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:55:27 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Flow 'volume_create_manager' (a4c7f037-469b-4f1e-b0e5-1042e2325c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b54a7-0d54-4f00-a806-7033fa5b59b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b54a7-0d54-4f00-a806-7033fa5b59b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1058503984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7320cf-6227-4057-98cd-3070aac62b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419e0fbb76574187956341639da5d931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:27Z,use_quota=True,user_id='2db044a1b65a44eaa79a559ea5a428b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34b78f4-4821-41b6-90a8-b04c6000270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34b78f4-4821-41b6-90a8-b04c6000270a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9637c8a2-ea7f-4231-a168-22bdbaae5867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9637c8a2-ea7f-4231-a168-22bdbaae5867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7320cf-6227-4057-98cd-3070aac62b7b', 'volume_name': 'volume-4f7320cf-6227-4057-98cd-3070aac62b7b', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d88e85-7965-40e5-b600-41e3563a0880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d88e85-7965-40e5-b600-41e3563a0880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f75994-9066-496e-bd0f-706028cef3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:27 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Volume 4f7320cf-6227-4057-98cd-3070aac62b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7320cf-6227-4057-98cd-3070aac62b7b', 'volume_size': 1}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1058503984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7320cf-6227-4057-98cd-3070aac62b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419e0fbb76574187956341639da5d931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:27Z,use_quota=True,user_id='2db044a1b65a44eaa79a559ea5a428b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Creating volume 4f7320cf-6227-4057-98cd-3070aac62b7b {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:55:27 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4f7320cf-6227-4057-98cd-3070aac62b7b 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:27 devstack quobyte-client[82822]: System call of process 99155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:55:27 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=119, name=volume-4f7320cf-6227-4057-98cd-3070aac62b7b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4f7320cf-6227-4057-98cd-3070aac62b7b 1073741824" returned: 0 in 0.433s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4f7320cf-6227-4057-98cd-3070aac62b7b {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4f7320cf-6227-4057-98cd-3070aac62b7b" returned: 0 in 0.100s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] <== create_volume: return (597ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:55:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.610s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f75994-9066-496e-bd0f-706028cef3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7320cf-6227-4057-98cd-3070aac62b7b', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e8dd0c-0501-44f5-8420-5b4f0e6be706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:28 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Volume volume-4f7320cf-6227-4057-98cd-3070aac62b7b (4f7320cf-6227-4057-98cd-3070aac62b7b): created successfully
Sep 18 13:55:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e8dd0c-0501-44f5-8420-5b4f0e6be706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Flow 'volume_create_manager' (a4c7f037-469b-4f1e-b0e5-1042e2325c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:28 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-344480d5-4792-4330-87db-cde1dcb94651 tempest-VolumesTransfersV355Test-744961420 None] Created volume successfully.
Sep 18 13:55:29 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-53cc2ff7-379f-4c9f-8ec1-e818e677b5ea tempest-VolumesTransfersV355Test-1809610210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:29 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-53cc2ff7-379f-4c9f-8ec1-e818e677b5ea tempest-VolumesTransfersV355Test-1809610210 None] Transfer volume completed successfully.
Sep 18 13:55:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Acquiring lock "cinder-4f7320cf-6227-4057-98cd-3070aac62b7b-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Lock "cinder-4f7320cf-6227-4057-98cd-3070aac62b7b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:31 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Acquiring lock "cinder-quobyte-4f7320cf-6227-4057-98cd-3070aac62b7b" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Lock "cinder-quobyte-4f7320cf-6227-4057-98cd-3070aac62b7b" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:31 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0a5c4e-8be2-48f3-8263-b226420e4f23]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:55:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4f7320cf-6227-4057-98cd-3070aac62b7b {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4f7320cf-6227-4057-98cd-3070aac62b7b" returned: 0 in 0.452s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4f7320cf-6227-4057-98cd-3070aac62b7b {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4f7320cf-6227-4057-98cd-3070aac62b7b" returned: 0 in 0.091s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Lock "cinder-quobyte-4f7320cf-6227-4057-98cd-3070aac62b7b" released by "delete_volume" :: held 0.705s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Created reservations ['4938de00-c09b-4667-b1e2-e6c0b31b3d57', '9277a621-f2bd-4016-bb3f-396cb7fd11a0', '85660a09-cbae-42bb-bfc7-01ba4208a2a4', '6a294f20-a365-4b9a-894b-3a8b2188d379'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.107s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:55:32 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Deleted volume successfully.
Sep 18 13:55:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1063b2ae-e54f-408b-9057-8b0d0898e800 tempest-VolumesTransfersV355Test-1149852577 None] Lock "cinder-4f7320cf-6227-4057-98cd-3070aac62b7b-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:33 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Flow 'volume_create_manager' (962692b4-c24d-471b-a455-4d4f58f1fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83623838-080e-427f-9aad-71d168fcd5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83623838-080e-427f-9aad-71d168fcd5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-93678331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfddc2ec-7ef6-4646-acb7-a37669419c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419e0fbb76574187956341639da5d931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:34Z,use_quota=True,user_id='2db044a1b65a44eaa79a559ea5a428b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2fcc56-c9ee-49a3-8c54-7a45006201dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2fcc56-c9ee-49a3-8c54-7a45006201dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6a3995-3dcc-4795-bf98-f551e1fb01b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6a3995-3dcc-4795-bf98-f551e1fb01b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfddc2ec-7ef6-4646-acb7-a37669419c21', 'volume_name': 'volume-dfddc2ec-7ef6-4646-acb7-a37669419c21', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bc9c98-e18e-483f-8ca7-8a0c174c648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bc9c98-e18e-483f-8ca7-8a0c174c648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0cd026d-579d-4442-9b8c-977d6dd8c8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:33 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Volume dfddc2ec-7ef6-4646-acb7-a37669419c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfddc2ec-7ef6-4646-acb7-a37669419c21', 'volume_size': 1}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-93678331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfddc2ec-7ef6-4646-acb7-a37669419c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419e0fbb76574187956341639da5d931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:34Z,use_quota=True,user_id='2db044a1b65a44eaa79a559ea5a428b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Creating volume dfddc2ec-7ef6-4646-acb7-a37669419c21 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:55:34 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dfddc2ec-7ef6-4646-acb7-a37669419c21 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:34 devstack quobyte-client[82822]: System call of process 99171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:55:34 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=120, name=volume-dfddc2ec-7ef6-4646-acb7-a37669419c21, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dfddc2ec-7ef6-4646-acb7-a37669419c21 1073741824" returned: 0 in 0.353s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dfddc2ec-7ef6-4646-acb7-a37669419c21 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dfddc2ec-7ef6-4646-acb7-a37669419c21" returned: 0 in 0.099s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] <== create_volume: return (525ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.540s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0cd026d-579d-4442-9b8c-977d6dd8c8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfddc2ec-7ef6-4646-acb7-a37669419c21', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566f1671-8eb3-4ec7-a29e-6450e0260b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:34 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Volume volume-dfddc2ec-7ef6-4646-acb7-a37669419c21 (dfddc2ec-7ef6-4646-acb7-a37669419c21): created successfully
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566f1671-8eb3-4ec7-a29e-6450e0260b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:34 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Flow 'volume_create_manager' (962692b4-c24d-471b-a455-4d4f58f1fff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-05b42cc0-c149-4de0-b384-0b71f0169733 tempest-VolumesTransfersV355Test-744961420 None] Created volume successfully.
Sep 18 13:55:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Acquiring lock "cinder-dfddc2ec-7ef6-4646-acb7-a37669419c21-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Lock "cinder-dfddc2ec-7ef6-4646-acb7-a37669419c21-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:36 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Acquiring lock "cinder-quobyte-dfddc2ec-7ef6-4646-acb7-a37669419c21" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Lock "cinder-quobyte-dfddc2ec-7ef6-4646-acb7-a37669419c21" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:36 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9404633c-f355-4dd0-a801-21aec2048c74]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:55:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dfddc2ec-7ef6-4646-acb7-a37669419c21 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dfddc2ec-7ef6-4646-acb7-a37669419c21" returned: 0 in 0.502s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dfddc2ec-7ef6-4646-acb7-a37669419c21 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dfddc2ec-7ef6-4646-acb7-a37669419c21" returned: 0 in 0.111s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Lock "cinder-quobyte-dfddc2ec-7ef6-4646-acb7-a37669419c21" released by "delete_volume" :: held 0.772s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Created reservations ['0012cd31-9268-4586-948f-c8e7ee30f086', '16ed5971-92a4-4af6-b0f4-ff56d4f004e0', 'b3fc9231-299e-4b81-a232-ff3b4fdf9ab6', '20410bbf-a290-492e-9141-748a6ee9be3a'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.094s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:37 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:55:38 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Deleted volume successfully.
Sep 18 13:55:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-75cc6c3b-8845-4b16-b17d-ba71dec66e09 tempest-VolumesTransfersV355Test-1149852577 None] Lock "cinder-dfddc2ec-7ef6-4646-acb7-a37669419c21-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:47 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=25,cinder:SELECT=13,cinder:INSERT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:55:48 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=12,cinder:UPDATE=15,cinder:DELETE=4,cinder:INSERT=6 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:55:49 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Flow 'volume_create_manager' (1a5147d7-52e6-4e96-ac29-59bbe452476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94e4a5b-5348-4473-a843-7f307c802d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94e4a5b-5348-4473-a843-7f307c802d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-240688141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06215471-f2d7-4bb6-9615-606cf5ac6ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0de9b6dc4ed4b9093f9688df8d6ec89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:49Z,use_quota=True,user_id='9c9791c1815e444da69dee0fb4b540df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d6beb7-a472-4ed6-bffd-a66ca1b20fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d6beb7-a472-4ed6-bffd-a66ca1b20fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c518d5b-1ec6-409d-a2e8-b866b4f643ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c518d5b-1ec6-409d-a2e8-b866b4f643ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06215471-f2d7-4bb6-9615-606cf5ac6ced', 'volume_name': 'volume-06215471-f2d7-4bb6-9615-606cf5ac6ced', 'volume_size': 2}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39fa05d-fabb-49fd-84a4-7f1b2514cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39fa05d-fabb-49fd-84a4-7f1b2514cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638159ce-fcc5-48c1-b128-abd4e504ab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:49 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Volume 06215471-f2d7-4bb6-9615-606cf5ac6ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06215471-f2d7-4bb6-9615-606cf5ac6ced', 'volume_size': 2}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-240688141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06215471-f2d7-4bb6-9615-606cf5ac6ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0de9b6dc4ed4b9093f9688df8d6ec89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:49Z,use_quota=True,user_id='9c9791c1815e444da69dee0fb4b540df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Creating volume 06215471-f2d7-4bb6-9615-606cf5ac6ced {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:55:49 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:55:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-06215471-f2d7-4bb6-9615-606cf5ac6ced 2147483648 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:50 devstack quobyte-client[82822]: System call of process 99272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:55:50 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=121, name=volume-06215471-f2d7-4bb6-9615-606cf5ac6ced, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:55:50 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-eae83580-6411-4f48-97a0-67ca71cf3750 tempest-TestShelveInstance-1812214623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:50 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-eae83580-6411-4f48-97a0-67ca71cf3750 tempest-TestShelveInstance-1812214623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:50 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-a4f9e167-11c8-4886-9131-29d0502d014a req-eae83580-6411-4f48-97a0-67ca71cf3750 tempest-TestShelveInstance-1812214623 None] Terminate volume connection completed successfully.
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-a4f9e167-11c8-4886-9131-29d0502d014a req-eae83580-6411-4f48-97a0-67ca71cf3750 tempest-TestShelveInstance-1812214623 None] Deleting attachment 8fcf6596-0b90-4df7-bff4-a06d1ef4ec21. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-06215471-f2d7-4bb6-9615-606cf5ac6ced 2147483648" returned: 0 in 0.575s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-06215471-f2d7-4bb6-9615-606cf5ac6ced {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-06215471-f2d7-4bb6-9615-606cf5ac6ced" returned: 0 in 0.094s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] <== create_volume: return (709ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638159ce-fcc5-48c1-b128-abd4e504ab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06215471-f2d7-4bb6-9615-606cf5ac6ced', 'volume_size': 2}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c578a2-0871-46a3-b3cd-d93d2655d57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:50 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Volume volume-06215471-f2d7-4bb6-9615-606cf5ac6ced (06215471-f2d7-4bb6-9615-606cf5ac6ced): created successfully
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c578a2-0871-46a3-b3cd-d93d2655d57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Flow 'volume_create_manager' (1a5147d7-52e6-4e96-ac29-59bbe452476a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:50 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-79325dc3-4758-423d-b49c-9b402baeaf4c tempest-VolumesCloneNegativeTest-593884456 None] Created volume successfully.
Sep 18 13:55:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Acquiring lock "cinder-6731347f-417c-4145-8c88-8f02de18b091-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Lock "cinder-6731347f-417c-4145-8c88-8f02de18b091-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:51 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Acquiring lock "cinder-quobyte-6731347f-417c-4145-8c88-8f02de18b091" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Lock "cinder-quobyte-6731347f-417c-4145-8c88-8f02de18b091" acquired by "delete_volume" :: waited 0.021s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:51 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[202fc292-3762-42ad-8b97-8af2c82ca32b]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:55:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 0 in 0.443s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Acquiring lock "cinder-06215471-f2d7-4bb6-9615-606cf5ac6ced-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Lock "cinder-06215471-f2d7-4bb6-9615-606cf5ac6ced-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:52 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Acquiring lock "cinder-quobyte-06215471-f2d7-4bb6-9615-606cf5ac6ced" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Lock "cinder-quobyte-06215471-f2d7-4bb6-9615-606cf5ac6ced" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 1 in 0.584s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba89efbb-082b-4b05-b327-ee204ff4ebeb]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-06215471-f2d7-4bb6-9615-606cf5ac6ced {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6731347f-417c-4145-8c88-8f02de18b091" returned: 0 in 0.184s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Lock "cinder-quobyte-6731347f-417c-4145-8c88-8f02de18b091" released by "delete_volume" :: held 1.452s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG cinder.quota [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Created reservations ['cc367e9c-0c08-461b-89e6-823e62ffb4be', '28722a92-c011-46d8-a7fe-14044fc4ec75', 'd25926f5-9a78-4eb4-8da4-0bbbcf252376', 'c7cd7b95-ad5d-4216-944a-34db6391b265'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:55:53 devstack quobyte-client[82822]: System call of process 99284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:55:53 devstack quobyte-client[82822]: System call of process 99284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-06215471-f2d7-4bb6-9615-606cf5ac6ced" returned: 0 in 0.665s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-06215471-f2d7-4bb6-9615-606cf5ac6ced {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-06215471-f2d7-4bb6-9615-606cf5ac6ced" returned: 0 in 0.423s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.206s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:53 devstack cinder-volume[82799]: DEBUG cinder.manager [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:55:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Deleted volume successfully.
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Lock "cinder-quobyte-06215471-f2d7-4bb6-9615-606cf5ac6ced" released by "delete_volume" :: held 1.614s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [req-a4f9e167-11c8-4886-9131-29d0502d014a req-8f83f9a2-6d61-4b9c-83c2-8d1e1b82d648 tempest-TestShelveInstance-1812214623 None] Lock "cinder-6731347f-417c-4145-8c88-8f02de18b091-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Created reservations ['7595c600-a2fa-4cd0-bca7-5c083f55a819', '14e20716-e497-41da-ba23-94e4d2391c3a', '10a5570c-a499-4bf7-b229-0bb04b464707', 'c3db564c-8a19-4acb-8fb2-bd1b5a3c3e3c'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.142s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:55:54 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:55:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Deleted volume successfully.
Sep 18 13:55:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5d367834-aebe-489c-9d65-11bd523cc53a tempest-VolumesCloneNegativeTest-593884456 None] Lock "cinder-06215471-f2d7-4bb6-9615-606cf5ac6ced-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:55:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Flow 'volume_create_manager' (73f6da53-b644-4ceb-b2ef-7d5c1ed24f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5bd25c-61ce-45ae-a280-119d0a4c57cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5bd25c-61ce-45ae-a280-119d0a4c57cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1766522999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6335a4-68b0-400f-a32b-569d8e77d988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2481ffbab02a4905bef7b3f68a077fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:59Z,use_quota=True,user_id='7e5870250fce465398466ab5cd9d9976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5172fff-936c-4941-8b24-02046a286f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5172fff-936c-4941-8b24-02046a286f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c641cf3-06d0-474c-b1f7-65fcdbc8d761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c641cf3-06d0-474c-b1f7-65fcdbc8d761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6335a4-68b0-400f-a32b-569d8e77d988', 'volume_name': 'volume-bb6335a4-68b0-400f-a32b-569d8e77d988', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530459ab-ccd6-419f-86bf-3fad3c17e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530459ab-ccd6-419f-86bf-3fad3c17e49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b47d997-fb56-418c-8192-dca48ec7581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:55:59 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Volume bb6335a4-68b0-400f-a32b-569d8e77d988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6335a4-68b0-400f-a32b-569d8e77d988', 'volume_size': 1}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1766522999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6335a4-68b0-400f-a32b-569d8e77d988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2481ffbab02a4905bef7b3f68a077fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:55:59Z,use_quota=True,user_id='7e5870250fce465398466ab5cd9d9976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Creating volume bb6335a4-68b0-400f-a32b-569d8e77d988 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:55:59 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:55:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bb6335a4-68b0-400f-a32b-569d8e77d988 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:00 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=122, name=volume-bb6335a4-68b0-400f-a32b-569d8e77d988, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bb6335a4-68b0-400f-a32b-569d8e77d988 1073741824" returned: 0 in 0.463s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bb6335a4-68b0-400f-a32b-569d8e77d988 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bb6335a4-68b0-400f-a32b-569d8e77d988" returned: 0 in 0.159s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] <== create_volume: return (717ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:56:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b47d997-fb56-418c-8192-dca48ec7581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6335a4-68b0-400f-a32b-569d8e77d988', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59191de8-ebdb-45c7-aee2-187d4636ac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:00 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Volume volume-bb6335a4-68b0-400f-a32b-569d8e77d988 (bb6335a4-68b0-400f-a32b-569d8e77d988): created successfully
Sep 18 13:56:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59191de8-ebdb-45c7-aee2-187d4636ac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Flow 'volume_create_manager' (73f6da53-b644-4ceb-b2ef-7d5c1ed24f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:00 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-a4a70ceb-cd99-44cf-986f-256a8c796892 tempest-VolumesNegativeTest-2094803556 None] Created volume successfully.
Sep 18 13:56:10 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:56:11 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=16,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:56:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:56:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.148s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:56:15 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (685d6b91-a9cc-4be4-bd8e-a421a4ac31af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336cdfdd-2974-4eef-bf88-d7aa0ca639b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336cdfdd-2974-4eef-bf88-d7aa0ca639b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615851000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ddb498-fdec-42e9-9529-99227e778818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:15Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b7b194-c196-46f2-ac3f-86b6907b08b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b7b194-c196-46f2-ac3f-86b6907b08b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d714207-348a-4c53-aadd-ad1e5587343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d714207-348a-4c53-aadd-ad1e5587343a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ddb498-fdec-42e9-9529-99227e778818', 'volume_name': 'volume-94ddb498-fdec-42e9-9529-99227e778818', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ce7e59-eaa2-4b9d-91cb-05e47b73c24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ce7e59-eaa2-4b9d-91cb-05e47b73c24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e326cd66-dfbb-423a-afe5-0511c96088fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:15 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume 94ddb498-fdec-42e9-9529-99227e778818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ddb498-fdec-42e9-9529-99227e778818', 'volume_size': 1}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615851000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ddb498-fdec-42e9-9529-99227e778818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:15Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Creating volume 94ddb498-fdec-42e9-9529-99227e778818 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:56:15 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:56:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:15 devstack quobyte-client[82822]: System call of process 99356 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:56:15 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=123, name=volume-94ddb498-fdec-42e9-9529-99227e778818, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 1073741824" returned: 0 in 0.467s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818" returned: 0 in 0.115s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] <== create_volume: return (653ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:56:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e326cd66-dfbb-423a-afe5-0511c96088fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ddb498-fdec-42e9-9529-99227e778818', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5bf516-63d5-49b1-8183-55dcb5f2b285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:16 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume volume-94ddb498-fdec-42e9-9529-99227e778818 (94ddb498-fdec-42e9-9529-99227e778818): created successfully
Sep 18 13:56:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5bf516-63d5-49b1-8183-55dcb5f2b285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (685d6b91-a9cc-4be4-bd8e-a421a4ac31af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-004a7da8-59c0-4cc9-a6e2-b31e1827adfd tempest-CreateVolumesFromSnapshotTest-762793630 None] Created volume successfully.
Sep 18 13:56:19 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Creating offline snapshot bd3935a9-7f79-4854-b0e6-6570ee6d158e of volume 94ddb498-fdec-42e9-9529-99227e778818 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:56:20 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da12c51-227d-4fac-bba2-f40eea4c88e6]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818" returned: 0 in 0.445s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:20 devstack quobyte-client[82822]: System call of process 99369 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:56:20 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=124, name=volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e 1G" returned: 0 in 0.296s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): qemu-img rebase -u -b volume-94ddb498-fdec-42e9-9529-99227e778818 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "qemu-img rebase -u -b volume-94ddb498-fdec-42e9-9529-99227e778818 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e" returned: 0 in 0.219s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e" returned: 0 in 0.136s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e" returned: 0 in 0.173s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.info" returned: 0 in 0.125s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.info" returned: 0 in 0.090s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:22 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bdc792fe-2109-4950-b547-00b9afb02f6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Create snapshot completed successfully
Sep 18 13:56:24 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:24 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:56:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (60f8368e-abb3-42a3-8a80-f29bdfc8b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ede183-185a-44d2-987c-f89b636835e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ede183-185a-44d2-987c-f89b636835e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459129642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61394b6c-eb2b-4584-bf10-daf7372fbc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:24Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67872ce-6a6e-486f-aee4-9593ef39f99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67872ce-6a6e-486f-aee4-9593ef39f99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245b995d-ca38-44b4-b8d0-180995e2e76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245b995d-ca38-44b4-b8d0-180995e2e76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61394b6c-eb2b-4584-bf10-daf7372fbc13', 'volume_name': 'volume-61394b6c-eb2b-4584-bf10-daf7372fbc13', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa8f51b-be73-4ed1-8f09-fe2265a03c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa8f51b-be73-4ed1-8f09-fe2265a03c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d8e0d3-fad8-41b9-b5f6-0e7847a4d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:25 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume 61394b6c-eb2b-4584-bf10-daf7372fbc13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61394b6c-eb2b-4584-bf10-daf7372fbc13', 'volume_size': 1}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459129642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61394b6c-eb2b-4584-bf10-daf7372fbc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:24Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Creating volume 61394b6c-eb2b-4584-bf10-daf7372fbc13 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:56:25 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61394b6c-eb2b-4584-bf10-daf7372fbc13 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:25 devstack quobyte-client[82822]: System call of process 99439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:56:25 devstack quobyte-client[82822]: System call of process 99439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:56:25 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=126, name=volume-61394b6c-eb2b-4584-bf10-daf7372fbc13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61394b6c-eb2b-4584-bf10-daf7372fbc13 1073741824" returned: 0 in 0.886s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61394b6c-eb2b-4584-bf10-daf7372fbc13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:26 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:26 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:56:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (6f6d96f3-4867-4273-8a20-9f1c7bb45c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:26 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050a2f1b-2e65-4e88-b9d6-3cbfab08e1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61394b6c-eb2b-4584-bf10-daf7372fbc13" returned: 0 in 1.154s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050a2f1b-2e65-4e88-b9d6-3cbfab08e1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-204940016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02104fc-1623-4138-8207-01c0334b8f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:25Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29de020f-102f-45d4-8ba2-490d273182e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29de020f-102f-45d4-8ba2-490d273182e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8eb51ec-15a5-4447-acc4-f22fd7ceeaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8eb51ec-15a5-4447-acc4-f22fd7ceeaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02104fc-1623-4138-8207-01c0334b8f81', 'volume_name': 'volume-f02104fc-1623-4138-8207-01c0334b8f81', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4654db8f-e880-4bf7-85b7-81b8dee6a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4654db8f-e880-4bf7-85b7-81b8dee6a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10d1009-f2c3-4374-b050-14aef94d9be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:27 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume f02104fc-1623-4138-8207-01c0334b8f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02104fc-1623-4138-8207-01c0334b8f81', 'volume_size': 1}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] <== create_volume: return (2194ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.206s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-204940016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02104fc-1623-4138-8207-01c0334b8f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:25Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Creating volume f02104fc-1623-4138-8207-01c0334b8f81 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:56:27 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f02104fc-1623-4138-8207-01c0334b8f81 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:27 devstack quobyte-client[82822]: System call of process 99449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:56:27 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=127, name=volume-f02104fc-1623-4138-8207-01c0334b8f81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:27 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:27 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (1664c919-8b56-4782-8882-23a27470d874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c0972d-3207-41b8-9f26-bb248119d5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d8e0d3-fad8-41b9-b5f6-0e7847a4d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61394b6c-eb2b-4584-bf10-daf7372fbc13', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d30f1f-ceb0-404d-b4eb-66103404a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (8e064e0a-fab7-41af-b18f-bbc779396b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6425a716-0de7-4c3a-a9cf-5cb440a00aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (a35559ee-0fdc-446d-9761-8fa5e337e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2d86f0-03a1-49f3-9c90-95341aa70e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c0972d-3207-41b8-9f26-bb248119d5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1660240817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b696c939-7af0-414b-ae00-8694d3c6e3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:26Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a23b2c-c41c-487c-99ae-aa73ae58e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a23b2c-c41c-487c-99ae-aa73ae58e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31d5cd9-c396-4a38-a1dc-2fb63d672908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31d5cd9-c396-4a38-a1dc-2fb63d672908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b696c939-7af0-414b-ae00-8694d3c6e3ae', 'volume_name': 'volume-b696c939-7af0-414b-ae00-8694d3c6e3ae', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e286e4-0c97-41e2-8366-43efbcad8732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e286e4-0c97-41e2-8366-43efbcad8732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4dcc0d-3273-4b83-a847-9ec5940cbeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume b696c939-7af0-414b-ae00-8694d3c6e3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b696c939-7af0-414b-ae00-8694d3c6e3ae', 'volume_size': 1}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f02104fc-1623-4138-8207-01c0334b8f81 1073741824" returned: 0 in 1.452s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6425a716-0de7-4c3a-a9cf-5cb440a00aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565170802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812b0722-fd6f-4324-871e-41fb4ded7582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:28Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebc9a47-fc43-4d36-a48a-dc887931989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebc9a47-fc43-4d36-a48a-dc887931989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec2d0b4-3191-4da0-85fe-e2421fbc41c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec2d0b4-3191-4da0-85fe-e2421fbc41c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812b0722-fd6f-4324-871e-41fb4ded7582', 'volume_name': 'volume-812b0722-fd6f-4324-871e-41fb4ded7582', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206340b0-c955-405d-b9ad-4db9039ff904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206340b0-c955-405d-b9ad-4db9039ff904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec09873-15dc-4f4b-92cf-22b288db2b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:28 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume 812b0722-fd6f-4324-871e-41fb4ded7582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812b0722-fd6f-4324-871e-41fb4ded7582', 'volume_size': 1}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:28 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume volume-61394b6c-eb2b-4584-bf10-daf7372fbc13 (61394b6c-eb2b-4584-bf10-daf7372fbc13): created successfully
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d30f1f-ceb0-404d-b4eb-66103404a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (60f8368e-abb3-42a3-8a80-f29bdfc8b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f02104fc-1623-4138-8207-01c0334b8f81 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:29 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-9805b491-badf-4f52-bb23-e6d8b64c65e3 tempest-CreateVolumesFromSnapshotTest-762793630 None] Created volume successfully.
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2d86f0-03a1-49f3-9c90-95341aa70e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686230224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff738f7b-0ad6-4c3f-ae55-95e4ac7da047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:27Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476e81c0-6de5-44e6-a979-bcf1be4bcffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476e81c0-6de5-44e6-a979-bcf1be4bcffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d0dcf5-1fd1-413e-b010-072b6bf86023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d0dcf5-1fd1-413e-b010-072b6bf86023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff738f7b-0ad6-4c3f-ae55-95e4ac7da047', 'volume_name': 'volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8372429d-7762-402b-a45c-dfb9737fa9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8372429d-7762-402b-a45c-dfb9737fa9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0debd72-2da2-48d4-81b8-6039efd927a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:29 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume ff738f7b-0ad6-4c3f-ae55-95e4ac7da047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047', 'volume_size': 1}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f02104fc-1623-4138-8207-01c0334b8f81" returned: 0 in 0.584s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] <== create_volume: return (2121ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.681s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1660240817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b696c939-7af0-414b-ae00-8694d3c6e3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:26Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Creating volume b696c939-7af0-414b-ae00-8694d3c6e3ae {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:56:29 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b696c939-7af0-414b-ae00-8694d3c6e3ae 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:29 devstack quobyte-client[82822]: System call of process 99463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:56:29 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=128, name=volume-b696c939-7af0-414b-ae00-8694d3c6e3ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10d1009-f2c3-4374-b050-14aef94d9be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02104fc-1623-4138-8207-01c0334b8f81', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75975a0-2bd3-4abf-92c3-6eaef355ed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:30 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume volume-f02104fc-1623-4138-8207-01c0334b8f81 (f02104fc-1623-4138-8207-01c0334b8f81): created successfully
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75975a0-2bd3-4abf-92c3-6eaef355ed3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (6f6d96f3-4867-4273-8a20-9f1c7bb45c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b696c939-7af0-414b-ae00-8694d3c6e3ae 1073741824" returned: 0 in 0.604s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b696c939-7af0-414b-ae00-8694d3c6e3ae {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:30 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7c6eef54-513c-4f56-b35f-baf01d9a9381 tempest-CreateVolumesFromSnapshotTest-762793630 None] Created volume successfully.
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b696c939-7af0-414b-ae00-8694d3c6e3ae" returned: 0 in 0.231s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] <== create_volume: return (864ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565170802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812b0722-fd6f-4324-871e-41fb4ded7582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:28Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Creating volume 812b0722-fd6f-4324-871e-41fb4ded7582 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:56:30 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-812b0722-fd6f-4324-871e-41fb4ded7582 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:30 devstack quobyte-client[82822]: System call of process 99467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:56:30 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=129, name=volume-812b0722-fd6f-4324-871e-41fb4ded7582, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4dcc0d-3273-4b83-a847-9ec5940cbeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b696c939-7af0-414b-ae00-8694d3c6e3ae', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bea9c92-3a10-4ece-a99a-c8c7e56b5f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:30 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume volume-b696c939-7af0-414b-ae00-8694d3c6e3ae (b696c939-7af0-414b-ae00-8694d3c6e3ae): created successfully
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bea9c92-3a10-4ece-a99a-c8c7e56b5f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (1664c919-8b56-4782-8882-23a27470d874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-812b0722-fd6f-4324-871e-41fb4ded7582 1073741824" returned: 0 in 0.576s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-812b0722-fd6f-4324-871e-41fb4ded7582 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-812b0722-fd6f-4324-871e-41fb4ded7582" returned: 0 in 0.385s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] <== create_volume: return (1017ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.090s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686230224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff738f7b-0ad6-4c3f-ae55-95e4ac7da047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b77b90e4acd44b385830ce3d5c3658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:27Z,use_quota=True,user_id='e6fb333db48d4db0a970e22068308328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Creating volume ff738f7b-0ad6-4c3f-ae55-95e4ac7da047 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:56:31 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:31 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=130, name=volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:31 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-17770a3e-59c2-4adc-be88-c62d97922110 tempest-CreateVolumesFromSnapshotTest-762793630 None] Created volume successfully.
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec09873-15dc-4f4b-92cf-22b288db2b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812b0722-fd6f-4324-871e-41fb4ded7582', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df61c9b-b905-4db4-b5f6-ef1777c05f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047 1073741824" returned: 0 in 0.539s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:32 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume volume-812b0722-fd6f-4324-871e-41fb4ded7582 (812b0722-fd6f-4324-871e-41fb4ded7582): created successfully
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df61c9b-b905-4db4-b5f6-ef1777c05f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (8e064e0a-fab7-41af-b18f-bbc779396b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047" returned: 0 in 0.465s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] <== create_volume: return (1040ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:32 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-94750870-83ac-46d1-831f-eb40d2c31140 tempest-CreateVolumesFromSnapshotTest-762793630 None] Created volume successfully.
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0debd72-2da2-48d4-81b8-6039efd927a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cd6f47-76dd-455a-aa2d-a37d82f0c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:32 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047 (ff738f7b-0ad6-4c3f-ae55-95e4ac7da047): created successfully
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cd6f47-76dd-455a-aa2d-a37d82f0c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Flow 'volume_create_manager' (a35559ee-0fdc-446d-9761-8fa5e337e342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:32 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-66b405b4-cd9e-4d90-8d45-e3d0f0ddc706 tempest-CreateVolumesFromSnapshotTest-762793630 None] Created volume successfully.
Sep 18 13:56:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-812b0722-fd6f-4324-871e-41fb4ded7582-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-812b0722-fd6f-4324-871e-41fb4ded7582-delete_volume" acquired by "delete_volume" :: waited 0.267s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-quobyte-812b0722-fd6f-4324-871e-41fb4ded7582" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-812b0722-fd6f-4324-871e-41fb4ded7582" acquired by "delete_volume" :: waited 0.050s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:34 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[39df7146-64a9-4d92-ace0-704cbf4def7a]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-812b0722-fd6f-4324-871e-41fb4ded7582 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-812b0722-fd6f-4324-871e-41fb4ded7582" returned: 0 in 0.946s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-812b0722-fd6f-4324-871e-41fb4ded7582 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-812b0722-fd6f-4324-871e-41fb4ded7582" returned: 0 in 0.276s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-812b0722-fd6f-4324-871e-41fb4ded7582" released by "delete_volume" :: held 1.517s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:36 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Created reservations ['43ac5823-067f-426d-8f6a-219ab88ab864', 'a4faa5b6-e6ee-4467-8803-202875047f53', '5be57311-2b80-463e-bb49-3e9a1af5de0c', '660a3c31-12b7-44d5-b569-d983e31aa427'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:56:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.299s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:37 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:56:37 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Deleted volume successfully.
Sep 18 13:56:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-6c3d6d40-3f29-4e20-a41e-fbb76cf472ee tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-812b0722-fd6f-4324-871e-41fb4ded7582-delete_volume" released by "delete_volume" :: held 3.784s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:38 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-quobyte-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047" acquired by "delete_volume" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:38 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df0cf57-6719-44c6-b096-9b312653fba2]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047" returned: 0 in 0.600s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047" returned: 0 in 0.091s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047" released by "delete_volume" :: held 0.856s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Created reservations ['772b4e30-cd80-4420-9d0e-d07d97f06850', 'f8035181-0c91-4ffe-9e37-da73305d059d', '9caf6d71-576b-47b3-af0c-e9dee860cbca', '2c4b700d-ce92-41d9-a713-e923b09f99a9'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.125s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:56:39 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Deleted volume successfully.
Sep 18 13:56:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ecb17f28-0a89-4edb-8128-59a7bdb1a85b tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-ff738f7b-0ad6-4c3f-ae55-95e4ac7da047-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-b696c939-7af0-414b-ae00-8694d3c6e3ae-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-b696c939-7af0-414b-ae00-8694d3c6e3ae-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:40 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-quobyte-b696c939-7af0-414b-ae00-8694d3c6e3ae" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-b696c939-7af0-414b-ae00-8694d3c6e3ae" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:40 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[166684bd-81ba-4d38-883b-fd8ca54936c9]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b696c939-7af0-414b-ae00-8694d3c6e3ae {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b696c939-7af0-414b-ae00-8694d3c6e3ae" returned: 0 in 0.425s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b696c939-7af0-414b-ae00-8694d3c6e3ae {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b696c939-7af0-414b-ae00-8694d3c6e3ae" returned: 0 in 0.088s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-b696c939-7af0-414b-ae00-8694d3c6e3ae" released by "delete_volume" :: held 0.673s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Created reservations ['26ac8262-c695-46a3-a57b-5581b56ce49e', '3d7e4bce-7219-4e85-8f3f-fbcc4d1b28b1', 'f70d4b5c-1ca0-4926-afa2-8e7df47ec364', 'ca778f40-e855-41d6-8a72-60840e09e46f'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.089s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:56:41 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Deleted volume successfully.
Sep 18 13:56:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-23bdcba9-f7d8-44ff-a1a8-d92ffb44edb5 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-b696c939-7af0-414b-ae00-8694d3c6e3ae-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-f02104fc-1623-4138-8207-01c0334b8f81-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-f02104fc-1623-4138-8207-01c0334b8f81-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:42 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-quobyte-f02104fc-1623-4138-8207-01c0334b8f81" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-f02104fc-1623-4138-8207-01c0334b8f81" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:42 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[987ee753-bb0f-483d-8152-9ce832fee410]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f02104fc-1623-4138-8207-01c0334b8f81 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f02104fc-1623-4138-8207-01c0334b8f81" returned: 0 in 0.473s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f02104fc-1623-4138-8207-01c0334b8f81 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f02104fc-1623-4138-8207-01c0334b8f81" returned: 0 in 0.115s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-f02104fc-1623-4138-8207-01c0334b8f81" released by "delete_volume" :: held 0.784s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:43 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Created reservations ['189d339a-5300-42a7-a6c9-31937fd0fb5b', 'bdc7db51-1eed-479c-b1e3-f5e213b182d9', 'afab3bd3-2a4a-4296-913a-170eb90ce7a8', '3419c506-d5c8-4cae-910f-e48d62db12bc'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.126s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:56:44 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Deleted volume successfully.
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fac68b9-c6d6-4e29-bfeb-4cac0d77bcbf tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-f02104fc-1623-4138-8207-01c0334b8f81-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-61394b6c-eb2b-4584-bf10-daf7372fbc13-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:44 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-61394b6c-eb2b-4584-bf10-daf7372fbc13-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:45 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:45 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-quobyte-61394b6c-eb2b-4584-bf10-daf7372fbc13" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:45 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-61394b6c-eb2b-4584-bf10-daf7372fbc13" acquired by "delete_volume" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:45 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[db918cfa-fea1-47cc-a423-7178c0b2b1a6]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61394b6c-eb2b-4584-bf10-daf7372fbc13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61394b6c-eb2b-4584-bf10-daf7372fbc13" returned: 0 in 0.502s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61394b6c-eb2b-4584-bf10-daf7372fbc13 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-61394b6c-eb2b-4584-bf10-daf7372fbc13" returned: 0 in 0.144s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-61394b6c-eb2b-4584-bf10-daf7372fbc13" released by "delete_volume" :: held 0.861s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Created reservations ['93377468-7d48-46e7-9a63-3d9ab9da31a1', '70a654d9-6213-43e8-8d1a-def589341d8b', 'af7f0e77-7474-46a1-b6d6-fa6f644345e6', '206fb21f-ccfe-4d44-aa88-812945e28f7d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.185s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:46 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:56:46 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Deleted volume successfully.
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2269bf20-4032-4368-b7fa-babd00007c6d tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-61394b6c-eb2b-4584-bf10-daf7372fbc13-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-bd3935a9-7f79-4854-b0e6-6570ee6d158e-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-bd3935a9-7f79-4854-b0e6-6570ee6d158e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-quobyte-94ddb498-fdec-42e9-9529-99227e778818" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-94ddb498-fdec-42e9-9529-99227e778818" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-quobyte-bd3935a9-7f79-4854-b0e6-6570ee6d158e" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-bd3935a9-7f79-4854-b0e6-6570ee6d158e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Deleting offline snapshot bd3935a9-7f79-4854-b0e6-6570ee6d158e of volume 94ddb498-fdec-42e9-9529-99227e778818 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] snapshot_file for this snap is: volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[991f969a-7b0d-4a09-86d7-f7509b302256]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e" returned: 0 in 0.434s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ddb498-fdec-42e9-9529-99227e778818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:56:47 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72ee49d-8829-4dfc-9e3a-4fdc5f1fe5cc]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818" returned: 0 in 0.476s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e" returned: 0 in 0.269s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818.bd3935a9-7f79-4854-b0e6-6570ee6d158e" returned: 0 in 0.110s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-bd3935a9-7f79-4854-b0e6-6570ee6d158e" released by "_delete_snapshot" :: held 1.671s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-94ddb498-fdec-42e9-9529-99227e778818" released by "delete_snapshot" :: held 1.702s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:49 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Created reservations ['a609ade8-5a9b-4da3-b94e-5022768bf39a', '375b5ba9-dabe-4bed-8849-e5b4c0e54218', '9a84088e-ab42-459b-97f5-596552ac2377', '973b9c33-f412-449e-817f-923c8698e2c0'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:56:49 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Delete snapshot completed successfully.
Sep 18 13:56:49 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e55e2ec4-8f5e-49f1-9adc-af6ad4fb62ec tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-bd3935a9-7f79-4854-b0e6-6570ee6d158e-delete_snapshot" released by "delete_snapshot" :: held 2.377s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-94ddb498-fdec-42e9-9529-99227e778818-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-94ddb498-fdec-42e9-9529-99227e778818-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:50 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "cinder-quobyte-94ddb498-fdec-42e9-9529-99227e778818" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:50 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-94ddb498-fdec-42e9-9529-99227e778818" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:50 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[43feb5b9-22f5-44c8-80ac-97e0b6645154]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Acquiring lock "cinder-bb6335a4-68b0-400f-a32b-569d8e77d988-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Lock "cinder-bb6335a4-68b0-400f-a32b-569d8e77d988-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:51 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Acquiring lock "cinder-quobyte-bb6335a4-68b0-400f-a32b-569d8e77d988" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Lock "cinder-quobyte-bb6335a4-68b0-400f-a32b-569d8e77d988" acquired by "delete_volume" :: waited 0.029s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818" returned: 0 in 0.599s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b80e525-bd2f-490d-a00e-6fcf7d02e21f]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bb6335a4-68b0-400f-a32b-569d8e77d988 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94ddb498-fdec-42e9-9529-99227e778818" returned: 0 in 0.203s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-quobyte-94ddb498-fdec-42e9-9529-99227e778818" released by "delete_volume" :: held 1.005s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Created reservations ['4433cbd6-be46-4a83-a386-a2c0d03dbb7c', 'e207e5d7-8fba-4c89-824d-d2a4685819d1', '758656e8-9232-40cb-89d6-225ff3be0971', 'addaa23f-0744-494b-8325-0df22fdd3603'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bb6335a4-68b0-400f-a32b-569d8e77d988" returned: 0 in 0.593s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bb6335a4-68b0-400f-a32b-569d8e77d988 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bb6335a4-68b0-400f-a32b-569d8e77d988" returned: 0 in 0.175s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Lock "cinder-quobyte-bb6335a4-68b0-400f-a32b-569d8e77d988" released by "delete_volume" :: held 1.055s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.154s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:52 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:56:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Deleted volume successfully.
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Created reservations ['5d76d489-f4ff-4e89-9071-2b98f0636573', '20185a86-9508-4074-bba2-39f2a436bb91', '9977717f-b4db-4286-aa20-c6f6371bc307', '20272812-1fff-4f80-8dd8-aca36cfaaed7'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e02803b6-00e2-4695-ad8f-f6e65b28df41 tempest-CreateVolumesFromSnapshotTest-762793630 None] Lock "cinder-94ddb498-fdec-42e9-9529-99227e778818-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.128s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:56:53 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Deleted volume successfully.
Sep 18 13:56:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c227a009-a7ce-4cb6-af6f-f9fb74cb555d tempest-VolumesNegativeTest-2094803556 None] Lock "cinder-bb6335a4-68b0-400f-a32b-569d8e77d988-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:56:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (049bf711-2c03-46be-9008-c7318777c7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba52ef44-5ca3-463c-8184-b2695dc0aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Flow 'volume_create_manager' (bdff687e-eeb8-4461-b9fe-96c238b3d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94c8cd0-7e1d-4613-8dba-be41ab4c8d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba52ef44-5ca3-463c-8184-b2695dc0aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137361418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1453b04a-8a25-4a19-b999-3815ccb858ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:57Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d104465-e636-4c93-a103-f5e20d782a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d104465-e636-4c93-a103-f5e20d782a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6255756-2ae7-41fb-93b1-01930d361635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6255756-2ae7-41fb-93b1-01930d361635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1453b04a-8a25-4a19-b999-3815ccb858ef', 'volume_name': 'volume-1453b04a-8a25-4a19-b999-3815ccb858ef', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261fad50-e8cc-49db-90ec-fee350f722f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261fad50-e8cc-49db-90ec-fee350f722f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be9ef6a-0345-4101-9a60-1fe301a24a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:57 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume 1453b04a-8a25-4a19-b999-3815ccb858ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1453b04a-8a25-4a19-b999-3815ccb858ef', 'volume_size': 1}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137361418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1453b04a-8a25-4a19-b999-3815ccb858ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:57Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Creating volume 1453b04a-8a25-4a19-b999-3815ccb858ef {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:56:57 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:56:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1453b04a-8a25-4a19-b999-3815ccb858ef 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:57 devstack quobyte-client[82822]: System call of process 99608 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:56:57 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=131, name=volume-1453b04a-8a25-4a19-b999-3815ccb858ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94c8cd0-7e1d-4613-8dba-be41ab4c8d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-32105536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73295458-8d7e-46ab-bed1-5fe649e5db81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f9118cf00244bd8281b33943752611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:57Z,use_quota=True,user_id='399950437f5043fc93c64a4d6e7c04b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aced1794-cf22-4471-822a-c2d6d0b33b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aced1794-cf22-4471-822a-c2d6d0b33b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d22c2d3-b9f9-4c17-bb18-548110e954f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d22c2d3-b9f9-4c17-bb18-548110e954f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73295458-8d7e-46ab-bed1-5fe649e5db81', 'volume_name': 'volume-73295458-8d7e-46ab-bed1-5fe649e5db81', 'volume_size': 2}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a846693d-76bc-44df-85ab-f21482c3a528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a846693d-76bc-44df-85ab-f21482c3a528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d236e35-0bce-4be4-9c03-37a2ee95e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:58 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Volume 73295458-8d7e-46ab-bed1-5fe649e5db81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73295458-8d7e-46ab-bed1-5fe649e5db81', 'volume_size': 2}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1453b04a-8a25-4a19-b999-3815ccb858ef 1073741824" returned: 0 in 0.399s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1453b04a-8a25-4a19-b999-3815ccb858ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1453b04a-8a25-4a19-b999-3815ccb858ef" returned: 0 in 0.130s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] <== create_volume: return (575ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.589s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-32105536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73295458-8d7e-46ab-bed1-5fe649e5db81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f9118cf00244bd8281b33943752611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:56:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:56:57Z,use_quota=True,user_id='399950437f5043fc93c64a4d6e7c04b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Creating volume 73295458-8d7e-46ab-bed1-5fe649e5db81 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:56:58 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 2147483648 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:58 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=132, name=volume-73295458-8d7e-46ab-bed1-5fe649e5db81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be9ef6a-0345-4101-9a60-1fe301a24a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1453b04a-8a25-4a19-b999-3815ccb858ef', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44da1f23-806e-4f1e-ab57-86691f7bc190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:58 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume volume-1453b04a-8a25-4a19-b999-3815ccb858ef (1453b04a-8a25-4a19-b999-3815ccb858ef): created successfully
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44da1f23-806e-4f1e-ab57-86691f7bc190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (049bf711-2c03-46be-9008-c7318777c7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:58 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-496eb0e3-4f8c-4335-8cb5-23f162722565 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created volume successfully.
Sep 18 13:56:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 2147483648" returned: 0 in 0.562s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:56:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81" returned: 0 in 0.122s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:56:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] <== create_volume: return (734ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:56:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:56:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d236e35-0bce-4be4-9c03-37a2ee95e501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73295458-8d7e-46ab-bed1-5fe649e5db81', 'volume_size': 2}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065ef2a7-74e1-47be-84af-3cae0962ef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:56:59 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Volume volume-73295458-8d7e-46ab-bed1-5fe649e5db81 (73295458-8d7e-46ab-bed1-5fe649e5db81): created successfully
Sep 18 13:56:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065ef2a7-74e1-47be-84af-3cae0962ef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:56:59 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Flow 'volume_create_manager' (bdff687e-eeb8-4461-b9fe-96c238b3d249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:56:59 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3c661c7b-c990-4862-8e16-b6fa4f58d8aa tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Created volume successfully.
Sep 18 13:57:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (37791529-5b40-4eb8-a303-b583162fe5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2425ac0b-30d2-45d4-b6e5-f8aff6890a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2425ac0b-30d2-45d4-b6e5-f8aff6890a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-45992852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0b6873-187e-4f49-8158-b71d313e0725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:00Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb0049e-17e0-42cb-807c-8bdae009b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb0049e-17e0-42cb-807c-8bdae009b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4acb6b-2f10-4da0-b54d-2240c30aed44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4acb6b-2f10-4da0-b54d-2240c30aed44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0b6873-187e-4f49-8158-b71d313e0725', 'volume_name': 'volume-dc0b6873-187e-4f49-8158-b71d313e0725', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb5fc1a-3c4d-4ecd-be99-242a3593d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb5fc1a-3c4d-4ecd-be99-242a3593d438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed32079-513a-4cfc-aa9b-2c781744a893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:00 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume dc0b6873-187e-4f49-8158-b71d313e0725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0b6873-187e-4f49-8158-b71d313e0725', 'volume_size': 1}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Creating offline snapshot b31c8cdf-e730-4674-b428-48ae7ca8ef6e of volume 73295458-8d7e-46ab-bed1-5fe649e5db81 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc577f96-b035-4c5b-9e90-18a7c2bb21f9]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:00 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:00 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:57:00 devstack quobyte-client[82822]: System call of process 99616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (e26296c8-3b73-4f37-af79-c46ff741c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc72470-0612-49a9-b0d4-88f6b2c09a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc72470-0612-49a9-b0d4-88f6b2c09a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235982427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9292af-a414-407b-bc13-ad7ef44dd4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:00Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5382bee-eb69-4666-826c-c92b50de1bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5382bee-eb69-4666-826c-c92b50de1bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f159de65-e41e-4048-add8-7da5a6482e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f159de65-e41e-4048-add8-7da5a6482e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a9292af-a414-407b-bc13-ad7ef44dd4d7', 'volume_name': 'volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc074068-1e10-457c-8fb8-d538e82b96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc074068-1e10-457c-8fb8-d538e82b96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d66620b-611d-4ad2-b82d-7f256546a6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume 8a9292af-a414-407b-bc13-ad7ef44dd4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7', 'volume_size': 1}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81" returned: 0 in 0.864s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e 2G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:01 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:57:01 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=133, name=volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (900ecf69-de59-4fb1-8613-443e6962ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5acd669a-d1ac-4577-bc95-458e255a1f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5acd669a-d1ac-4577-bc95-458e255a1f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1086973160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c47394-ab02-45d3-8656-28cca62fdce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:01Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb35576-3651-42e8-97b9-5f67b985831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb35576-3651-42e8-97b9-5f67b985831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc33f2ac-10b1-404e-a833-4d90d48dc272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc33f2ac-10b1-404e-a833-4d90d48dc272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c47394-ab02-45d3-8656-28cca62fdce3', 'volume_name': 'volume-63c47394-ab02-45d3-8656-28cca62fdce3', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702490a5-a310-4ded-89e9-d4ba2ca717a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702490a5-a310-4ded-89e9-d4ba2ca717a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c869571-cf93-418c-9547-d0ff76365a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:01 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume 63c47394-ab02-45d3-8656-28cca62fdce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c47394-ab02-45d3-8656-28cca62fdce3', 'volume_size': 1}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e 2G" returned: 0 in 0.669s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): qemu-img rebase -u -b volume-73295458-8d7e-46ab-bed1-5fe649e5db81 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (b456d533-1310-4449-9904-e7d8cb52436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfe9e7e-6316-487c-9766-f87df6538f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfe9e7e-6316-487c-9766-f87df6538f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775860468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94232fb3-3635-49b7-b717-24be0b8b5233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:01Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d33708-0e13-4efd-8b7c-943cdf8342a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d33708-0e13-4efd-8b7c-943cdf8342a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3022cb4a-cdeb-4d00-b5cb-8953ac595e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3022cb4a-cdeb-4d00-b5cb-8953ac595e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94232fb3-3635-49b7-b717-24be0b8b5233', 'volume_name': 'volume-94232fb3-3635-49b7-b717-24be0b8b5233', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9827a6-ce89-4a17-9129-f015b9f630a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9827a6-ce89-4a17-9129-f015b9f630a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de83525-ed07-4c70-83cf-6ad61968f976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume 94232fb3-3635-49b7-b717-24be0b8b5233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94232fb3-3635-49b7-b717-24be0b8b5233', 'volume_size': 1}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "qemu-img rebase -u -b volume-73295458-8d7e-46ab-bed1-5fe649e5db81 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e" returned: 0 in 0.599s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:02 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (6c536453-7883-4757-bf52-3be73ef55149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf1415f-e770-4e78-b0f8-6abafc43e025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e" returned: 0 in 0.401s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf1415f-e770-4e78-b0f8-6abafc43e025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1557593847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c65ba10-7d2c-49b1-b701-5bc345f6e619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:02Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f985ec5-7f33-4649-b346-3ccbbb83047b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f985ec5-7f33-4649-b346-3ccbbb83047b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3f5050-d5d5-47dd-b290-439e321e2524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3f5050-d5d5-47dd-b290-439e321e2524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c65ba10-7d2c-49b1-b701-5bc345f6e619', 'volume_name': 'volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d8cba1-6b9d-4898-b5d6-3f215be5de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d8cba1-6b9d-4898-b5d6-3f215be5de1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cd7d6a-1535-4fee-ad77-2435932dcb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:02 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume 5c65ba10-7d2c-49b1-b701-5bc345f6e619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619', 'volume_size': 1}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 13:57:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e" returned: 0 in 0.156s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.info" returned: 0 in 0.113s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.info" returned: 0 in 0.117s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.337s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.242s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-45992852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0b6873-187e-4f49-8158-b71d313e0725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:00Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Creating volume dc0b6873-187e-4f49-8158-b71d313e0725 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:57:03 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:57:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dc0b6873-187e-4f49-8158-b71d313e0725 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:03 devstack quobyte-client[82822]: System call of process 99637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:57:03 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=135, name=volume-dc0b6873-187e-4f49-8158-b71d313e0725, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dc0b6873-187e-4f49-8158-b71d313e0725 1073741824" returned: 0 in 0.368s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dc0b6873-187e-4f49-8158-b71d313e0725 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:04 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-27d9b994-e7e3-485b-ad90-d32b3bcde85d tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Create snapshot completed successfully
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dc0b6873-187e-4f49-8158-b71d313e0725" returned: 0 in 0.276s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] <== create_volume: return (690ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.129s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235982427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9292af-a414-407b-bc13-ad7ef44dd4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:00Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Creating volume 8a9292af-a414-407b-bc13-ad7ef44dd4d7 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:57:04 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:04 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=136, name=volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Acquiring lock "cinder-b31c8cdf-e730-4674-b428-48ae7ca8ef6e-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed32079-513a-4cfc-aa9b-2c781744a893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0b6873-187e-4f49-8158-b71d313e0725', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366069a6-acea-4b9e-a30c-f7e11bd2bd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7 1073741824" returned: 0 in 0.498s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:04 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-b31c8cdf-e730-4674-b428-48ae7ca8ef6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.308s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:05 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Acquiring lock "cinder-quobyte-73295458-8d7e-46ab-bed1-5fe649e5db81" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:05 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume volume-dc0b6873-187e-4f49-8158-b71d313e0725 (dc0b6873-187e-4f49-8158-b71d313e0725): created successfully
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366069a6-acea-4b9e-a30c-f7e11bd2bd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (37791529-5b40-4eb8-a303-b583162fe5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7" returned: 0 in 0.399s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] <== create_volume: return (940ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-quobyte-73295458-8d7e-46ab-bed1-5fe649e5db81" acquired by "delete_snapshot" :: waited 0.262s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Acquiring lock "cinder-quobyte-b31c8cdf-e730-4674-b428-48ae7ca8ef6e" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.428s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1086973160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c47394-ab02-45d3-8656-28cca62fdce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:01Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Creating volume 63c47394-ab02-45d3-8656-28cca62fdce3 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:57:05 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-63c47394-ab02-45d3-8656-28cca62fdce3 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:05 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=137, name=volume-63c47394-ab02-45d3-8656-28cca62fdce3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:05 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-806bf343-34db-4981-9219-e940305fcfc6 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created volume successfully.
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d66620b-611d-4ad2-b82d-7f256546a6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1e3284-747c-4363-a850-843f35734cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-quobyte-b31c8cdf-e730-4674-b428-48ae7ca8ef6e" acquired by "_delete_snapshot" :: waited 0.526s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Deleting offline snapshot b31c8cdf-e730-4674-b428-48ae7ca8ef6e of volume 73295458-8d7e-46ab-bed1-5fe649e5db81 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] snapshot_file for this snap is: volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 13:57:05 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7 (8a9292af-a414-407b-bc13-ad7ef44dd4d7): created successfully
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1e3284-747c-4363-a850-843f35734cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (e26296c8-3b73-4f37-af79-c46ff741c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-63c47394-ab02-45d3-8656-28cca62fdce3 1073741824" returned: 0 in 0.555s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f5dd78-db27-4e23-9ead-d643c99955c8]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-63c47394-ab02-45d3-8656-28cca62fdce3 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:06 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7b478387-7107-4c80-bca1-ec27e3658be9 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created volume successfully.
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-63c47394-ab02-45d3-8656-28cca62fdce3" returned: 0 in 0.371s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] <== create_volume: return (956ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.828s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775860468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94232fb3-3635-49b7-b717-24be0b8b5233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:01Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Creating volume 94232fb3-3635-49b7-b717-24be0b8b5233 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:57:06 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94232fb3-3635-49b7-b717-24be0b8b5233 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:06 devstack quobyte-client[82822]: System call of process 99649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:57:06 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=138, name=volume-94232fb3-3635-49b7-b717-24be0b8b5233, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c869571-cf93-418c-9547-d0ff76365a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c47394-ab02-45d3-8656-28cca62fdce3', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaff3932-bfee-428c-ac50-4dd47a825ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e" returned: 0 in 0.826s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73295458-8d7e-46ab-bed1-5fe649e5db81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c869b348-28bc-46ca-bb96-184e850bd489]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:06 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume volume-63c47394-ab02-45d3-8656-28cca62fdce3 (63c47394-ab02-45d3-8656-28cca62fdce3): created successfully
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaff3932-bfee-428c-ac50-4dd47a825ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (900ecf69-de59-4fb1-8613-443e6962ad12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94232fb3-3635-49b7-b717-24be0b8b5233 1073741824" returned: 0 in 0.800s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94232fb3-3635-49b7-b717-24be0b8b5233 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:07 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0475c40d-31a5-4b8d-8311-b0a3f1810e34 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created volume successfully.
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94232fb3-3635-49b7-b717-24be0b8b5233" returned: 0 in 0.276s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] <== create_volume: return (1105ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.514s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1557593847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c65ba10-7d2c-49b1-b701-5bc345f6e619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f13f6304292446c85fd88ae1fb47b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:02Z,use_quota=True,user_id='96baaf3266c4466aa9d073ad50db72f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Creating volume 5c65ba10-7d2c-49b1-b701-5bc345f6e619 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:57:07 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:07 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=139, name=volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de83525-ed07-4c70-83cf-6ad61968f976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94232fb3-3635-49b7-b717-24be0b8b5233', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b71b5b-fa83-49c9-b6eb-921f171a2e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81" returned: 0 in 1.071s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619 1073741824" returned: 0 in 0.557s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:08 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume volume-94232fb3-3635-49b7-b717-24be0b8b5233 (94232fb3-3635-49b7-b717-24be0b8b5233): created successfully
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b71b5b-fa83-49c9-b6eb-921f171a2e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (b456d533-1310-4449-9904-e7d8cb52436b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e" returned: 0 in 0.494s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619" returned: 0 in 0.319s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] <== create_volume: return (982ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:08 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-96586f31-8cc9-427a-b44e-0fce7d360d8a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created volume successfully.
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81.b31c8cdf-e730-4674-b428-48ae7ca8ef6e" returned: 0 in 0.256s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cd7d6a-1535-4fee-ad77-2435932dcb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c11fb54-c707-4ab7-9919-7085f92ff46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-quobyte-b31c8cdf-e730-4674-b428-48ae7ca8ef6e" released by "_delete_snapshot" :: held 2.977s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-quobyte-73295458-8d7e-46ab-bed1-5fe649e5db81" released by "delete_snapshot" :: held 3.514s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:08 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619 (5c65ba10-7d2c-49b1-b701-5bc345f6e619): created successfully
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c11fb54-c707-4ab7-9919-7085f92ff46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Flow 'volume_create_manager' (6c536453-7883-4757-bf52-3be73ef55149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:09 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e3689d56-42fc-46ae-af94-055e1e5ee24b tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created volume successfully.
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Created reservations ['7b7588cc-db56-4254-9636-e410a8449986', '5f747486-0a09-4b41-b008-fa8c0b2095c5', 'd9b7e636-e6f6-4aea-8fd3-a5f04a55664c', 'cbf0dca2-a3dd-4f3f-995b-08c0b9c1e494'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:57:09 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Delete snapshot completed successfully.
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-fc415aef-9084-43da-bed1-33d98dd92de0 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-b31c8cdf-e730-4674-b428-48ae7ca8ef6e-delete_snapshot" released by "delete_snapshot" :: held 4.195s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-5c65ba10-7d2c-49b1-b701-5bc345f6e619-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-5c65ba10-7d2c-49b1-b701-5bc345f6e619-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-quobyte-5c65ba10-7d2c-49b1-b701-5bc345f6e619" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-5c65ba10-7d2c-49b1-b701-5bc345f6e619" acquired by "delete_volume" :: waited 0.012s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd56fbf-57bd-4844-83ca-960cc42da32c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619" returned: 0 in 0.440s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Acquiring lock "cinder-73295458-8d7e-46ab-bed1-5fe649e5db81-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-5c65ba10-7d2c-49b1-b701-5bc345f6e619" returned: 0 in 0.308s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-73295458-8d7e-46ab-bed1-5fe649e5db81-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-5c65ba10-7d2c-49b1-b701-5bc345f6e619" released by "delete_volume" :: held 0.980s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:10 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Acquiring lock "cinder-quobyte-73295458-8d7e-46ab-bed1-5fe649e5db81" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-quobyte-73295458-8d7e-46ab-bed1-5fe649e5db81" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:10 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created reservations ['db940b3a-aeb9-448a-b90e-2aa6ae83ad11', 'f157788f-d68b-4c7b-bf99-7d8a9c2ec237', '5dcc0527-312d-44b1-886f-4fb453a2d57f', '03d903a1-7ede-43cf-a0ad-8c87d755f05a'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:57:10 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[390b3b6b-b207-49ef-8039-24716fb62858]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81" returned: 0 in 0.667s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.252s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:57:11 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Deleted volume successfully.
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=66,cinder:UPDATE=92,cinder:DELETE=14,cinder:INSERT=22 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-73295458-8d7e-46ab-bed1-5fe649e5db81" returned: 0 in 0.325s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-94232fb3-3635-49b7-b717-24be0b8b5233-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-quobyte-73295458-8d7e-46ab-bed1-5fe649e5db81" released by "delete_volume" :: held 1.210s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=115,cinder:SELECT=67,cinder:DELETE=9,cinder:INSERT=18 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fd7d747-6eaa-4666-a774-887c25a5b361 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-5c65ba10-7d2c-49b1-b701-5bc345f6e619-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-94232fb3-3635-49b7-b717-24be0b8b5233-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:11 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Created reservations ['09e57e3d-053d-4936-87d7-45cee02d94d4', '5ff4e5f9-7b34-4ced-8aea-3f2b3d37b50e', 'e160e247-e752-4549-933b-161b1aefe163', '633f440c-e9ed-4a33-a781-978e37e847f4'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:57:12 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-quobyte-94232fb3-3635-49b7-b717-24be0b8b5233" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-94232fb3-3635-49b7-b717-24be0b8b5233" acquired by "delete_volume" :: waited 0.024s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b971c8a-2743-4d7a-bf3c-aa31604cd05a]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94232fb3-3635-49b7-b717-24be0b8b5233 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.041s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.197s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94232fb3-3635-49b7-b717-24be0b8b5233" returned: 0 in 0.803s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94232fb3-3635-49b7-b717-24be0b8b5233 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:13 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Deleted volume successfully.
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-94232fb3-3635-49b7-b717-24be0b8b5233" returned: 0 in 0.323s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.586s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-94232fb3-3635-49b7-b717-24be0b8b5233" released by "delete_volume" :: held 1.514s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b059b84a-54c4-4178-a2fd-8a4a6b149ea3 tempest-VolumesSnapshotNegativeTestJSON-688387193 None] Lock "cinder-73295458-8d7e-46ab-bed1-5fe649e5db81-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created reservations ['b0f0cb8c-23c1-4d3f-88d8-87d51f05cf79', '64aef51c-8d51-449e-af85-a0f84b2aadfc', 'ae6ebd09-45cd-40a0-8348-19eac75ef1ee', '7c8c49f8-083b-4b87-8bfd-90d8a163c828'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-63c47394-ab02-45d3-8656-28cca62fdce3-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.376s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:14 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:57:14 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Deleted volume successfully.
Sep 18 13:57:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-63c47394-ab02-45d3-8656-28cca62fdce3-delete_volume" acquired by "delete_volume" :: waited 0.267s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-81bda8ba-8464-4952-a12f-d77aae55ed3c tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-94232fb3-3635-49b7-b717-24be0b8b5233-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:14 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-quobyte-63c47394-ab02-45d3-8656-28cca62fdce3" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:14 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-63c47394-ab02-45d3-8656-28cca62fdce3" acquired by "delete_volume" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:14 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1561c6-cc09-4054-a4b0-66e85d211a98]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-63c47394-ab02-45d3-8656-28cca62fdce3 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-63c47394-ab02-45d3-8656-28cca62fdce3" returned: 0 in 0.478s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-63c47394-ab02-45d3-8656-28cca62fdce3 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-63c47394-ab02-45d3-8656-28cca62fdce3" returned: 0 in 0.124s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-63c47394-ab02-45d3-8656-28cca62fdce3" released by "delete_volume" :: held 0.815s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created reservations ['fe30b5d4-1171-4f4d-9c1d-e3630fe15e36', 'd2109952-d6fb-4bcd-942d-bccf8723caf7', '6495bbbf-ddc0-48dc-b4c7-6a5b62744a1c', '6aa55e70-bee2-4dbb-a693-dcb01d23ea28'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.114s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:16 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:57:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Deleted volume successfully.
Sep 18 13:57:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-48c92fa5-0807-4a1e-a513-5ce91d9ff9b4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-63c47394-ab02-45d3-8656-28cca62fdce3-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-8a9292af-a414-407b-bc13-ad7ef44dd4d7-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-8a9292af-a414-407b-bc13-ad7ef44dd4d7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-quobyte-8a9292af-a414-407b-bc13-ad7ef44dd4d7" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-8a9292af-a414-407b-bc13-ad7ef44dd4d7" acquired by "delete_volume" :: waited 0.012s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:16 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a281ff60-2b57-4f19-8639-3ff1b8b9d08b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7" returned: 0 in 0.554s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-8a9292af-a414-407b-bc13-ad7ef44dd4d7" returned: 0 in 0.121s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-8a9292af-a414-407b-bc13-ad7ef44dd4d7" released by "delete_volume" :: held 0.891s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created reservations ['afe30260-16b9-44ff-8078-ee9af1c31998', 'b45804b9-3362-4a3f-827d-8f5fbfdc7e88', '0bff4b61-8ee7-4564-95a6-fb2c1390c9ca', 'baf475a6-ff4b-4792-9a90-8ab755d63f37'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.097s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:57:18 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Deleted volume successfully.
Sep 18 13:57:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f04baeb1-acf7-4ae9-8d2d-d2532d17e1a4 tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-8a9292af-a414-407b-bc13-ad7ef44dd4d7-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:19 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-dc0b6873-187e-4f49-8158-b71d313e0725-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:19 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-dc0b6873-187e-4f49-8158-b71d313e0725-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:19 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:19 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-quobyte-dc0b6873-187e-4f49-8158-b71d313e0725" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:19 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-dc0b6873-187e-4f49-8158-b71d313e0725" acquired by "delete_volume" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:19 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3371d2-a962-4a00-9e30-16bacc145b76]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dc0b6873-187e-4f49-8158-b71d313e0725 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dc0b6873-187e-4f49-8158-b71d313e0725" returned: 0 in 0.455s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dc0b6873-187e-4f49-8158-b71d313e0725 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-dc0b6873-187e-4f49-8158-b71d313e0725" returned: 0 in 0.087s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-dc0b6873-187e-4f49-8158-b71d313e0725" released by "delete_volume" :: held 0.709s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created reservations ['0b81a222-8a4e-48e5-b8d2-6ff7166b6b47', '6540035a-9429-4baa-97b7-f7870bcdbe77', '2f1050aa-e2cb-44e2-88bb-1eed9acf3555', '381d8796-5264-412e-8420-fbe279bd5f28'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.101s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:20 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:57:20 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Deleted volume successfully.
Sep 18 13:57:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c944a22b-b612-4440-a5dc-4ad8b84cbb7a tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-dc0b6873-187e-4f49-8158-b71d313e0725-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-1453b04a-8a25-4a19-b999-3815ccb858ef-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-1453b04a-8a25-4a19-b999-3815ccb858ef-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:21 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "cinder-quobyte-1453b04a-8a25-4a19-b999-3815ccb858ef" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-1453b04a-8a25-4a19-b999-3815ccb858ef" acquired by "delete_volume" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:21 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecdff4e-1027-43e3-aee0-ca10c2dbfd72]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1453b04a-8a25-4a19-b999-3815ccb858ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1453b04a-8a25-4a19-b999-3815ccb858ef" returned: 0 in 0.486s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1453b04a-8a25-4a19-b999-3815ccb858ef {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-1453b04a-8a25-4a19-b999-3815ccb858ef" returned: 0 in 0.134s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-quobyte-1453b04a-8a25-4a19-b999-3815ccb858ef" released by "delete_volume" :: held 0.799s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Created reservations ['47cb731a-90ac-40fd-9ec2-87a5466435dd', 'aa252be8-b898-4ce4-9ae2-e1e794dce05a', 'ef559a2e-25db-4bc1-9f58-d8e27795b878', '4f2761d7-13aa-430d-9ced-6aa8fafc343c'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.128s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:57:23 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Deleted volume successfully.
Sep 18 13:57:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d3563f1a-2a19-4aba-b477-a7c840c5730d tempest-CreateVolumesFromSourceVolumeTest-985783418 None] Lock "cinder-1453b04a-8a25-4a19-b999-3815ccb858ef-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:31 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:31 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:57:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Flow 'volume_create_manager' (b7297145-7322-416d-9df2-bf8f6ab71020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d135ba15-3a50-4eb0-a7f8-d705058b5718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d135ba15-3a50-4eb0-a7f8-d705058b5718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37aea77-e847-4402-b8ac-9eed21120486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12819b110f4b9abb6031c3593273bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:31Z,use_quota=True,user_id='82cc2f4da1824da5baddeb65d8ae92bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b516592-a85d-43a4-a558-2105551a0221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b516592-a85d-43a4-a558-2105551a0221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:31 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d84117-8c77-42e4-8b95-65578bf26302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:31 devstack cinder-volume[82799]: DEBUG cinder.image.glance [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Creating Keystone auth plugin from conf {{(pid=82799) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 13:57:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d84117-8c77-42e4-8b95-65578bf26302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a37aea77-e847-4402-b8ac-9eed21120486', 'volume_name': 'volume-a37aea77-e847-4402-b8ac-9eed21120486', 'volume_size': 1, 'image_id': '636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '14a83d8de66f3aad41cd4205669d2e02', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d12819b110f4b9abb6031c3593273bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04edcc10d85c0301af7d445ce8a3f8854215c7ced5787cc96f45ac0e53ce1ebdc810853eb963ce27036037f53a70df3d123b06c61859480f875a2c2bda6b296d', 'id': '636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'created_at': datetime.datetime(2025, 9, 18, 11, 57, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 57, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/636e45c7-c2e8-462d-ab1e-6ed329f05ec1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8bfaf6a0>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aba6ea4-cdcd-44c6-a975-95326d3b54d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aba6ea4-cdcd-44c6-a975-95326d3b54d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:32 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2143cf-3f71-4c64-9d15-734f655f1f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:32 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Volume a37aea77-e847-4402-b8ac-9eed21120486: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a37aea77-e847-4402-b8ac-9eed21120486', 'volume_size': 1, 'image_id': '636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '14a83d8de66f3aad41cd4205669d2e02', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d12819b110f4b9abb6031c3593273bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04edcc10d85c0301af7d445ce8a3f8854215c7ced5787cc96f45ac0e53ce1ebdc810853eb963ce27036037f53a70df3d123b06c61859480f875a2c2bda6b296d', 'id': '636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'created_at': datetime.datetime(2025, 9, 18, 11, 57, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 57, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/636e45c7-c2e8-462d-ab1e-6ed329f05ec1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8bfaf6a0>}
Sep 18 13:57:32 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Cloning a37aea77-e847-4402-b8ac-9eed21120486 from image 636e45c7-c2e8-462d-ab1e-6ed329f05ec1  at location (None, [{'url': 'file:///opt/stack/data/glance/images/636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'metadata': {}}]). {{(pid=82799) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 13:57:32 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 13:57:32 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Image download 0.00 MB at 0.00 MB/s
Sep 18 13:57:32 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f450391-c105-4d85-a487-0205320fdbd8]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:32 devstack sudo[99709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD
Sep 18 13:57:32 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:57:34 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root
Sep 18 13:57:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD" returned: 0 in 2.274s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:35 devstack sudo[99713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD
Sep 18 13:57:35 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:57:36 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root
Sep 18 13:57:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD" returned: 1 in 2.219s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:57:36 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Temporary image 636e45c7-c2e8-462d-ab1e-6ed329f05ec1 is fetched for user 82cc2f4da1824da5baddeb65d8ae92bc. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 13:57:37 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fbc922-a532-48a2-8a36-704bc83d9134]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:37 devstack sudo[99720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD
Sep 18 13:57:37 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:57:39 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root
Sep 18 13:57:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD" returned: 0 in 2.576s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:40 devstack sudo[99724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD
Sep 18 13:57:40 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:57:42 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD" returned: 1 in 2.565s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37aea77-e847-4402-b8ac-9eed21120486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d12819b110f4b9abb6031c3593273bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:31Z,use_quota=True,user_id='82cc2f4da1824da5baddeb65d8ae92bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Creating volume a37aea77-e847-4402-b8ac-9eed21120486 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:57:42 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:57:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:42 devstack quobyte-client[82822]: System call of process 99730 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:57:42 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=140, name=volume-a37aea77-e847-4402-b8ac-9eed21120486, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 1073741824" returned: 0 in 0.421s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486" returned: 0 in 0.106s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] <== create_volume: return (641ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:57:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:43 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Attempting download of 636e45c7-c2e8-462d-ab1e-6ed329f05ec1 ((None, [{'url': 'file:///opt/stack/data/glance/images/636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'metadata': {}}])) to volume a37aea77-e847-4402-b8ac-9eed21120486. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 13:57:43 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81c4db7-351f-4d79-b771-a06e52c66274]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_7pnk0300 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_7pnk0300" returned: 0 in 0.624s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_7pnk0300 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_7pnk0300" returned: 1 in 0.588s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_7pnk0300' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:57:44 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b293b2df-58ab-48f9-b1a4-938bb0dc7b8e]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:46 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Flow 'volume_create_manager' (2e92471e-c44a-4982-be0f-b6201cd599cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4a12ce-e14c-44a5-beb5-95e1e8e303ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4a12ce-e14c-44a5-beb5-95e1e8e303ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-237753334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d565235-2941-4a91-b1d3-582e580d88f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3706f8ae3a438697869dca94ca7e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:45Z,use_quota=True,user_id='dff2c67ac86c4f8aaab857e0cb2b975b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50a82111-c629-4614-ae68-55a76baa5cad),volume_type_id=50a82111-c629-4614-ae68-55a76baa5cad)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de38e6c1-0771-4fbe-aa5b-edd829fe9c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de38e6c1-0771-4fbe-aa5b-edd829fe9c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2a4e4-a592-4151-a821-508477fccc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2a4e4-a592-4151-a821-508477fccc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d565235-2941-4a91-b1d3-582e580d88f2', 'volume_name': 'volume-2d565235-2941-4a91-b1d3-582e580d88f2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cd3547-2f15-4d20-aa8f-1b51015524ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cd3547-2f15-4d20-aa8f-1b51015524ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bccfb22-a588-4fbc-baad-0300a54e6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:46 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume 2d565235-2941-4a91-b1d3-582e580d88f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d565235-2941-4a91-b1d3-582e580d88f2', 'volume_size': 1}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-237753334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d565235-2941-4a91-b1d3-582e580d88f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3706f8ae3a438697869dca94ca7e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:45Z,use_quota=True,user_id='dff2c67ac86c4f8aaab857e0cb2b975b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50a82111-c629-4614-ae68-55a76baa5cad),volume_type_id=50a82111-c629-4614-ae68-55a76baa5cad)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Creating volume 2d565235-2941-4a91-b1d3-582e580d88f2 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:57:46 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:57:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:46 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=141, name=volume-2d565235-2941-4a91-b1d3-582e580d88f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD" returned: 1 in 1.453s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] 636e45c7-c2e8-462d-ab1e-6ed329f05ec1 was raw, converting to raw {{(pid=82799) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:47 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=140, name=volume-a37aea77-e847-4402-b8ac-9eed21120486, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Flow 'volume_create_manager' (ac84399f-429a-45a1-ac24-e95dec463fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad971209-193b-4bc2-b331-027900910af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2 1073741824" returned: 0 in 0.987s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486" returned: 0 in 0.496s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_636e45c7-c2e8-462d-ab1e-6ed329f05ec1_qfyczg0_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:57:47 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Converted 0.00 MB image at 0.00 MB/s
Sep 18 13:57:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad971209-193b-4bc2-b331-027900910af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129255457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5622dd-126c-42da-aa7f-6caa90179450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3706f8ae3a438697869dca94ca7e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:46Z,use_quota=True,user_id='dff2c67ac86c4f8aaab857e0cb2b975b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3c61f89-427d-4bee-be6d-b5f118d4e34b),volume_type_id=a3c61f89-427d-4bee-be6d-b5f118d4e34b)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34243971-03ff-4826-878f-33c1c60285b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34243971-03ff-4826-878f-33c1c60285b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc467ba3-7c14-44c0-a4e7-733ce9ab30a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc467ba3-7c14-44c0-a4e7-733ce9ab30a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5622dd-126c-42da-aa7f-6caa90179450', 'volume_name': 'volume-6a5622dd-126c-42da-aa7f-6caa90179450', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd55841-bab5-4fb1-98fb-a58e93ec847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd55841-bab5-4fb1-98fb-a58e93ec847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572f5e28-ba5c-419a-a005-5df22b6cbb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:48 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume 6a5622dd-126c-42da-aa7f-6caa90179450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5622dd-126c-42da-aa7f-6caa90179450', 'volume_size': 1}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:48 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Flow 'volume_create_manager' (779024df-83b0-49ba-ac73-99eda77848de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b6eec5-40f5-4ada-82d6-f687391056b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b6eec5-40f5-4ada-82d6-f687391056b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1713784434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3706f8ae3a438697869dca94ca7e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:47Z,use_quota=True,user_id='dff2c67ac86c4f8aaab857e0cb2b975b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(602fd91d-a690-44d0-98bc-a017b803b743),volume_type_id=602fd91d-a690-44d0-98bc-a017b803b743)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ede3cb6-2988-4bd0-8f38-e0a6ba884c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ede3cb6-2988-4bd0-8f38-e0a6ba884c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da577c3b-86c3-4bbc-a640-6ac600dad370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.image.glance [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Creating Keystone auth plugin from conf {{(pid=82799) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2" returned: 0 in 0.726s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] <== create_volume: return (1735ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.373s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129255457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5622dd-126c-42da-aa7f-6caa90179450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3706f8ae3a438697869dca94ca7e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:46Z,use_quota=True,user_id='dff2c67ac86c4f8aaab857e0cb2b975b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3c61f89-427d-4bee-be6d-b5f118d4e34b),volume_type_id=a3c61f89-427d-4bee-be6d-b5f118d4e34b)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Creating volume 6a5622dd-126c-42da-aa7f-6caa90179450 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:57:48 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 1G" returned: 0 in 0.703s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:48 devstack quobyte-client[82822]: System call of process 99754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:57:48 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=142, name=volume-6a5622dd-126c-42da-aa7f-6caa90179450, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bccfb22-a588-4fbc-baad-0300a54e6edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d565235-2941-4a91-b1d3-582e580d88f2', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e060b235-e23c-484e-8e81-e71c27a851f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:49 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[894b9250-4828-4b8b-af28-78c670643ce6]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:49 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume volume-2d565235-2941-4a91-b1d3-582e580d88f2 (2d565235-2941-4a91-b1d3-582e580d88f2): created successfully
Sep 18 13:57:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e060b235-e23c-484e-8e81-e71c27a851f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Flow 'volume_create_manager' (2e92471e-c44a-4982-be0f-b6201cd599cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450 1073741824" returned: 0 in 0.995s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:49 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-485ae697-0c29-4a3b-b475-19347eaed5b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Created volume successfully.
Sep 18 13:57:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486" returned: 0 in 0.808s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da577c3b-86c3-4bbc-a640-6ac600dad370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c', 'volume_name': 'volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c', 'volume_size': 1, 'image_id': 'c101d646-02a5-4759-ad74-431a3cd27fb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c101d646-02a5-4759-ad74-431a3cd27fb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--222324854', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3706f8ae3a438697869dca94ca7e97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c101d646-02a5-4759-ad74-431a3cd27fb2', 'created_at': datetime.datetime(2025, 9, 18, 11, 57, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 57, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c101d646-02a5-4759-ad74-431a3cd27fb2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c02af50>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b36c54-653b-4877-9d2d-0ec32d4dfce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b36c54-653b-4877-9d2d-0ec32d4dfce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c31fd4b-7a4b-4e0d-9f10-ed05d631d53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:50 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c', 'volume_size': 1, 'image_id': 'c101d646-02a5-4759-ad74-431a3cd27fb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c101d646-02a5-4759-ad74-431a3cd27fb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--222324854', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3706f8ae3a438697869dca94ca7e97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c101d646-02a5-4759-ad74-431a3cd27fb2', 'created_at': datetime.datetime(2025, 9, 18, 11, 57, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 57, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c101d646-02a5-4759-ad74-431a3cd27fb2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c02af50>}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Cloning acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c from image c101d646-02a5-4759-ad74-431a3cd27fb2  at location (None, [{'url': 'file:///opt/stack/data/glance/images/c101d646-02a5-4759-ad74-431a3cd27fb2', 'metadata': {}}]). {{(pid=82799) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450" returned: 0 in 0.661s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] <== create_volume: return (1694ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572f5e28-ba5c-419a-a005-5df22b6cbb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5622dd-126c-42da-aa7f-6caa90179450', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37572ea2-be85-4c66-b5c3-2e7ccb8e22be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:50 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume volume-6a5622dd-126c-42da-aa7f-6caa90179450 (6a5622dd-126c-42da-aa7f-6caa90179450): created successfully
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37572ea2-be85-4c66-b5c3-2e7ccb8e22be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Flow 'volume_create_manager' (ac84399f-429a-45a1-ac24-e95dec463fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486" returned: 1 in 0.574s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Downloaded image 636e45c7-c2e8-462d-ab1e-6ed329f05ec1 ((None, [{'url': 'file:///opt/stack/data/glance/images/636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'metadata': {}}])) to volume a37aea77-e847-4402-b8ac-9eed21120486 successfully. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Temporary image 636e45c7-c2e8-462d-ab1e-6ed329f05ec1 for user 82cc2f4da1824da5baddeb65d8ae92bc is deleted. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Marking volume a37aea77-e847-4402-b8ac-9eed21120486 as bootable. {{(pid=82799) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 13:57:50 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-955bc301-945d-4407-bad1-5580cf4b77dd tempest-TestInstancesWithCinderVolumes-1270170056 None] Created volume successfully.
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Copying metadata from image 636e45c7-c2e8-462d-ab1e-6ed329f05ec1 to a37aea77-e847-4402-b8ac-9eed21120486. {{(pid=82799) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Creating volume glance metadata for volume a37aea77-e847-4402-b8ac-9eed21120486 backed by image 636e45c7-c2e8-462d-ab1e-6ed329f05ec1 with: {'image_id': '636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '14a83d8de66f3aad41cd4205669d2e02', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82799) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2143cf-3f71-4c64-9d15-734f655f1f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37aea77-e847-4402-b8ac-9eed21120486', 'volume_size': 1, 'image_id': '636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '14a83d8de66f3aad41cd4205669d2e02', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d12819b110f4b9abb6031c3593273bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04edcc10d85c0301af7d445ce8a3f8854215c7ced5787cc96f45ac0e53ce1ebdc810853eb963ce27036037f53a70df3d123b06c61859480f875a2c2bda6b296d', 'id': '636e45c7-c2e8-462d-ab1e-6ed329f05ec1', 'created_at': datetime.datetime(2025, 9, 18, 11, 57, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 57, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/636e45c7-c2e8-462d-ab1e-6ed329f05ec1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8bfaf6a0>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c2d54b-a4d4-42ff-bcfa-fc61811d8eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:57:50 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Volume volume-a37aea77-e847-4402-b8ac-9eed21120486 (a37aea77-e847-4402-b8ac-9eed21120486): created successfully
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c2d54b-a4d4-42ff-bcfa-fc61811d8eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:57:50 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Flow 'volume_create_manager' (b7297145-7322-416d-9df2-bf8f6ab71020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:57:50 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1cc45f3b-8c2f-4439-b700-d16627d8f29f tempest-VolumeImageDependencyTests-921878675 None] Created volume successfully.
Sep 18 13:57:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Acquiring lock "cinder-a37aea77-e847-4402-b8ac-9eed21120486-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Lock "cinder-a37aea77-e847-4402-b8ac-9eed21120486-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:51 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:57:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Acquiring lock "cinder-quobyte-a37aea77-e847-4402-b8ac-9eed21120486" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 13:57:51 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Lock "cinder-quobyte-a37aea77-e847-4402-b8ac-9eed21120486" acquired by "delete_volume" :: waited 0.018s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 13:57:51 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9c2536-bdff-4997-834b-c1b456718fc8]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:52 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD, size 20.69 MB, duration 2.12 sec {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 13:57:52 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Image download 20.69 MB at 9.75 MB/s
Sep 18 13:57:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486" returned: 0 in 0.480s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:52 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c73e712-5b7d-40fa-9ca3-de1a91d45e79]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486" returned: 1 in 0.524s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a37aea77-e847-4402-b8ac-9eed21120486" returned: 0 in 0.098s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Lock "cinder-quobyte-a37aea77-e847-4402-b8ac-9eed21120486" released by "delete_volume" :: held 1.321s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:53 devstack sudo[99767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD
Sep 18 13:57:53 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Created reservations ['bcf025b1-f37b-4673-989e-a466f5253dba', '0fea744f-8170-4993-8006-1f85fb5c3f94', '3f67e59a-6ab3-4b1c-8a00-2a2d952d29b1', 'bcd58fdc-fdb7-492e-9481-8e9778aae287'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.123s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:53 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:57:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Deleted volume successfully.
Sep 18 13:57:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2f7ea206-068e-4684-99e7-6a8733c31c2e tempest-VolumeImageDependencyTests-921878675 None] Lock "cinder-a37aea77-e847-4402-b8ac-9eed21120486-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 13:57:55 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root
Sep 18 13:57:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD" returned: 0 in 2.904s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:55 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Temporary image c101d646-02a5-4759-ad74-431a3cd27fb2 is fetched for user dff2c67ac86c4f8aaab857e0cb2b975b. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 13:57:55 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87dd5ff-4c21-4eb9-9d5e-f0efb40d847b]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:56 devstack sudo[99776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD
Sep 18 13:57:56 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 13:57:58 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD" returned: 0 in 2.698s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T11:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1713784434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3706f8ae3a438697869dca94ca7e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T11:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T11:57:47Z,use_quota=True,user_id='dff2c67ac86c4f8aaab857e0cb2b975b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(602fd91d-a690-44d0-98bc-a017b803b743),volume_type_id=602fd91d-a690-44d0-98bc-a017b803b743)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Creating volume acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 13:57:58 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:58 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=143, name=volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:57:58 devstack quobyte-client[82822]: System call of process 99814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c 1073741824" returned: 0 in 0.291s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" returned: 0 in 0.174s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:59 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] <== create_volume: return (552ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 13:57:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.582s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:57:59 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Attempting download of c101d646-02a5-4759-ad74-431a3cd27fb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c101d646-02a5-4759-ad74-431a3cd27fb2', 'metadata': {}}])) to volume acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 13:57:59 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7633d28-198f-4f92-b201-8f7f04590faa]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:57:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c101d646-02a5-4759-ad74-431a3cd27fb2_ycq9p9um {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:57:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c101d646-02a5-4759-ad74-431a3cd27fb2_ycq9p9um" returned: 0 in 0.338s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:57:59 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c101d646-02a5-4759-ad74-431a3cd27fb2_ycq9p9um {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:58:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c101d646-02a5-4759-ad74-431a3cd27fb2_ycq9p9um" returned: 1 in 0.356s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:58:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c101d646-02a5-4759-ad74-431a3cd27fb2_ycq9p9um' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:58:00 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cab53fa-4e49-4da8-b0bc-c03d806de89c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:58:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:58:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:58:00 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] c101d646-02a5-4759-ad74-431a3cd27fb2 was qcow2, converting to raw {{(pid=82799) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 13:58:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:58:00 devstack quobyte-client[82822]: System call of process 99825 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:58:00 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=143, name=volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 13:58:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" returned: 0 in 0.987s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:58:01 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c101d646-02a5-4759-ad74-431a3cd27fb2_fq_c5ueydevstack@QuobyteHD, size 112.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 13:58:01 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Converted 112.00 MB image at 109.87 MB/s
Sep 18 13:58:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:58:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c 1G" returned: 0 in 0.139s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:58:01 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b592eb02-b81d-4fa4-b2f1-f4e4b2af6376]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:58:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:58:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" returned: 0 in 0.390s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:58:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:58:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" returned: 1 in 0.363s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:58:02 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:58:02 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Downloaded image c101d646-02a5-4759-ad74-431a3cd27fb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c101d646-02a5-4759-ad74-431a3cd27fb2', 'metadata': {}}])) to volume acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c successfully. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 13:58:02 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Temporary image c101d646-02a5-4759-ad74-431a3cd27fb2 for user dff2c67ac86c4f8aaab857e0cb2b975b is deleted. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 13:58:02 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Marking volume acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c as bootable. {{(pid=82799) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 13:58:02 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Copying metadata from image c101d646-02a5-4759-ad74-431a3cd27fb2 to acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c. {{(pid=82799) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 13:58:02 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Creating volume glance metadata for volume acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c backed by image c101d646-02a5-4759-ad74-431a3cd27fb2 with: {'image_id': 'c101d646-02a5-4759-ad74-431a3cd27fb2', 'image_name': 'tempest-scenario-img--222324854', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82799) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 13:58:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c31fd4b-7a4b-4e0d-9f10-ed05d631d53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c', 'volume_size': 1, 'image_id': 'c101d646-02a5-4759-ad74-431a3cd27fb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c101d646-02a5-4759-ad74-431a3cd27fb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--222324854', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3706f8ae3a438697869dca94ca7e97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c101d646-02a5-4759-ad74-431a3cd27fb2', 'created_at': datetime.datetime(2025, 9, 18, 11, 57, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 11, 57, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c101d646-02a5-4759-ad74-431a3cd27fb2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c02af50>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:58:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180d5b6f-8d4a-421b-a441-498b89f092b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 13:58:03 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c (acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c): created successfully
Sep 18 13:58:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180d5b6f-8d4a-421b-a441-498b89f092b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 13:58:03 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Flow 'volume_create_manager' (779024df-83b0-49ba-ac73-99eda77848de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 13:58:03 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-09ac6351-b324-428c-bdeb-8ede8e5da0b5 tempest-TestInstancesWithCinderVolumes-1270170056 None] Created volume successfully.
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=77,cinder:SELECT=46,cinder:DELETE=4,cinder:INSERT=17 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=54,cinder:UPDATE=57,cinder:INSERT=29,cinder:DELETE=7 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee2f5a6-56bb-4e9c-9cf1-e01e6559c173]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" returned: 0 in 0.456s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:58:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:58:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.168s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:58:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:58:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" returned: 1 in 0.498s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:58:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 13:58:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.054s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:58:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e191c84-67a3-4763-82d5-d0fb78c724eb', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:58:13 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:58:13 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-c4327981-ad4a-49d5-b9b2-51f592ffcbd3 req-e417c714-afcd-4463-a504-1c58f6805735 tempest-TestInstancesWithCinderVolumes-1270170056 None] attachment_update completed successfully.
Sep 18 13:58:23 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:58:23 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:59:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 13:59:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:59:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:59:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 13:59:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 13:59:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:59:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:59:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.105s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:59:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 13:59:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-17a913b5-204b-40cd-89f4-e9a26ada6c52 req-3b2c44ce-67cd-4bcb-aee0-de9d0880b3b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:59:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-17a913b5-204b-40cd-89f4-e9a26ada6c52 req-3b2c44ce-67cd-4bcb-aee0-de9d0880b3b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:59:24 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7858db2-a1ee-49dc-8da6-fde3e888ea3e]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:59:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-17a913b5-204b-40cd-89f4-e9a26ada6c52 req-3b2c44ce-67cd-4bcb-aee0-de9d0880b3b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:59:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-17a913b5-204b-40cd-89f4-e9a26ada6c52 req-3b2c44ce-67cd-4bcb-aee0-de9d0880b3b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2" returned: 0 in 0.484s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:59:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-17a913b5-204b-40cd-89f4-e9a26ada6c52 req-3b2c44ce-67cd-4bcb-aee0-de9d0880b3b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.565s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:59:25 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-17a913b5-204b-40cd-89f4-e9a26ada6c52 req-3b2c44ce-67cd-4bcb-aee0-de9d0880b3b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-2d565235-2941-4a91-b1d3-582e580d88f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '801361c8-f75f-4ab3-8fcf-d387884e6050', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:59:25 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-17a913b5-204b-40cd-89f4-e9a26ada6c52 req-3b2c44ce-67cd-4bcb-aee0-de9d0880b3b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:59:25 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-17a913b5-204b-40cd-89f4-e9a26ada6c52 req-3b2c44ce-67cd-4bcb-aee0-de9d0880b3b3 tempest-TestInstancesWithCinderVolumes-1270170056 None] attachment_update completed successfully.
Sep 18 13:59:35 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:59:35 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=1,cinder:SELECT=7 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:59:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c0b293dd-a165-49da-a0bf-eac2b65c2426 req-f8bfcb11-2493-44b2-8a16-152623cacf17 tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 13:59:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c0b293dd-a165-49da-a0bf-eac2b65c2426 req-f8bfcb11-2493-44b2-8a16-152623cacf17 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 13:59:35 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb04560-a9f4-47e3-b840-087628ccb5dd]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 13:59:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c0b293dd-a165-49da-a0bf-eac2b65c2426 req-f8bfcb11-2493-44b2-8a16-152623cacf17 tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 13:59:35 devstack quobyte-client[82822]: System call of process 100471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 13:59:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-c0b293dd-a165-49da-a0bf-eac2b65c2426 req-f8bfcb11-2493-44b2-8a16-152623cacf17 tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450" returned: 0 in 0.402s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 13:59:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-c0b293dd-a165-49da-a0bf-eac2b65c2426 req-f8bfcb11-2493-44b2-8a16-152623cacf17 tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.458s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 13:59:36 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-c0b293dd-a165-49da-a0bf-eac2b65c2426 req-f8bfcb11-2493-44b2-8a16-152623cacf17 tempest-TestInstancesWithCinderVolumes-1270170056 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-6a5622dd-126c-42da-aa7f-6caa90179450', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e137acd0-5a62-479b-9bb8-e63b53beac91', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 13:59:36 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-c0b293dd-a165-49da-a0bf-eac2b65c2426 req-f8bfcb11-2493-44b2-8a16-152623cacf17 tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 13:59:36 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-c0b293dd-a165-49da-a0bf-eac2b65c2426 req-f8bfcb11-2493-44b2-8a16-152623cacf17 tempest-TestInstancesWithCinderVolumes-1270170056 None] attachment_update completed successfully.
Sep 18 13:59:46 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=6 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 13:59:46 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:00:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-48642587-2cbd-457f-b4f7-eb5147194b85 req-75df8144-4941-44b2-abc7-79d445e633fd tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:00:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-48642587-2cbd-457f-b4f7-eb5147194b85 req-75df8144-4941-44b2-abc7-79d445e633fd tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:00:09 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-48642587-2cbd-457f-b4f7-eb5147194b85 req-75df8144-4941-44b2-abc7-79d445e633fd tempest-TestInstancesWithCinderVolumes-1270170056 None] Terminate volume connection completed successfully.
Sep 18 14:00:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-48642587-2cbd-457f-b4f7-eb5147194b85 req-75df8144-4941-44b2-abc7-79d445e633fd tempest-TestInstancesWithCinderVolumes-1270170056 None] Deleting attachment 801361c8-f75f-4ab3-8fcf-d387884e6050. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 14:00:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "cinder-2d565235-2941-4a91-b1d3-582e580d88f2-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:00:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-2d565235-2941-4a91-b1d3-582e580d88f2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:00:11 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:00:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "cinder-quobyte-2d565235-2941-4a91-b1d3-582e580d88f2" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:00:11 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-quobyte-2d565235-2941-4a91-b1d3-582e580d88f2" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:00:11 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[36381047-db27-4901-b3a4-5d6c539d6edd]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:00:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:12 devstack quobyte-client[82822]: System call of process 100562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2" returned: 0 in 0.495s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-2d565235-2941-4a91-b1d3-582e580d88f2" returned: 0 in 0.107s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-quobyte-2d565235-2941-4a91-b1d3-582e580d88f2" released by "delete_volume" :: held 0.761s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:00:12 devstack cinder-volume[82799]: WARNING cinder.quota [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868871562-1496384008 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868871562-1496384008, it is now deprecated. Please use the default quota class for default quota.
Sep 18 14:00:12 devstack cinder-volume[82799]: WARNING cinder.quota [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868871562-1496384008 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868871562-1496384008, it is now deprecated. Please use the default quota class for default quota.
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Created reservations ['477745f6-86d9-402b-ba06-08f661e16080', 'b285a14d-96c2-4c84-b26c-114918dfa60b', 'e3d81b66-9110-49d5-9f22-ec93e2586c86', '744c1d4a-1942-49f5-be67-ea1b80cac3a0'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.087s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:00:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:00:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:00:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:00:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:13 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Deleted volume successfully.
Sep 18 14:00:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.565s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:00:13 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1fedfd72-d1d7-45ca-8fbf-7abbacb425aa tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-2d565235-2941-4a91-b1d3-582e580d88f2-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:00:22 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=6,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:00:23 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:00:40 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-2db4fb13-b6c3-4334-8c40-b6099a34c032 req-fff475ef-8100-4f68-ae96-99dd3405deef tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:00:40 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-2db4fb13-b6c3-4334-8c40-b6099a34c032 req-fff475ef-8100-4f68-ae96-99dd3405deef tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:00:40 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-2db4fb13-b6c3-4334-8c40-b6099a34c032 req-fff475ef-8100-4f68-ae96-99dd3405deef tempest-TestInstancesWithCinderVolumes-1270170056 None] Terminate volume connection completed successfully.
Sep 18 14:00:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-2db4fb13-b6c3-4334-8c40-b6099a34c032 req-fff475ef-8100-4f68-ae96-99dd3405deef tempest-TestInstancesWithCinderVolumes-1270170056 None] Deleting attachment e137acd0-5a62-479b-9bb8-e63b53beac91. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 14:00:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "cinder-6a5622dd-126c-42da-aa7f-6caa90179450-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:00:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-6a5622dd-126c-42da-aa7f-6caa90179450-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:00:41 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:00:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "cinder-quobyte-6a5622dd-126c-42da-aa7f-6caa90179450" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:00:41 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-quobyte-6a5622dd-126c-42da-aa7f-6caa90179450" acquired by "delete_volume" :: waited 0.014s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:00:41 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb16c89d-5c56-4b0d-bfca-30a4a752bc76]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:00:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450" returned: 0 in 0.544s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-6a5622dd-126c-42da-aa7f-6caa90179450" returned: 0 in 0.108s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-quobyte-6a5622dd-126c-42da-aa7f-6caa90179450" released by "delete_volume" :: held 0.824s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:00:42 devstack cinder-volume[82799]: WARNING cinder.quota [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-186594498-1237020982 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-186594498-1237020982, it is now deprecated. Please use the default quota class for default quota.
Sep 18 14:00:42 devstack cinder-volume[82799]: WARNING cinder.quota [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-186594498-1237020982 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-186594498-1237020982, it is now deprecated. Please use the default quota class for default quota.
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Created reservations ['b5b291ee-81b7-4a5b-abe4-a3787fb78e16', '708272e1-4e21-4cda-9661-61957c773360', '1058fa0d-24ca-4f6f-84ce-66a41dc59751', 'ccf53475-64d5-4353-b1b6-a38bb5290d6e'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.114s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:00:43 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Deleted volume successfully.
Sep 18 14:00:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-e545fda6-b509-44e3-a995-8b5b59c26a9b tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-6a5622dd-126c-42da-aa7f-6caa90179450-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:00:52 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-a93dc60d-1c92-4a4c-8b6e-eabaafa21342 req-375d1b7a-168a-46f7-8640-e0a0fd10152d tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:00:52 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-a93dc60d-1c92-4a4c-8b6e-eabaafa21342 req-375d1b7a-168a-46f7-8640-e0a0fd10152d tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:00:52 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-a93dc60d-1c92-4a4c-8b6e-eabaafa21342 req-375d1b7a-168a-46f7-8640-e0a0fd10152d tempest-TestInstancesWithCinderVolumes-1270170056 None] Terminate volume connection completed successfully.
Sep 18 14:00:52 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-a93dc60d-1c92-4a4c-8b6e-eabaafa21342 req-375d1b7a-168a-46f7-8640-e0a0fd10152d tempest-TestInstancesWithCinderVolumes-1270170056 None] Deleting attachment 3e191c84-67a3-4763-82d5-d0fb78c724eb. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 14:00:56 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "cinder-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:00:56 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:00:56 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:00:56 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "cinder-quobyte-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:00:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-quobyte-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:00:57 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fde2a4-80ad-4b1d-899e-039b658e9a73]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:00:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" returned: 0 in 0.382s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" returned: 1 in 0.337s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 14:00:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" returned: 0 in 0.096s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-quobyte-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c" released by "delete_volume" :: held 1.086s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:00:58 devstack cinder-volume[82799]: WARNING cinder.quota [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-11613040-500537480 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-11613040-500537480, it is now deprecated. Please use the default quota class for default quota.
Sep 18 14:00:58 devstack cinder-volume[82799]: WARNING cinder.quota [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-11613040-500537480 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-11613040-500537480, it is now deprecated. Please use the default quota class for default quota.
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Created reservations ['37cdd84f-1762-4a76-9f7e-c895cffa1592', '798450a1-33f3-4fa8-ace6-885cf3289dba', 'ded0f1b1-1db3-40d9-a2f5-4c635bd6ffdc', '3bf06b88-9358-42bd-8eab-4fb2b3f0842e'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.082s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:00:58 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Deleted volume successfully.
Sep 18 14:00:58 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-20d270af-e825-4108-8ef8-6ac25c66103f tempest-TestInstancesWithCinderVolumes-1270170056 None] Lock "cinder-acba2e0a-f7da-4aa5-9b30-2907ba7d4b6c-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:01:08 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=9,cinder:UPDATE=15,cinder:INSERT=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:01:08 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=15,cinder:UPDATE=17,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:01:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 14:01:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:01:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:01:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:01:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:01:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:01:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:01:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.108s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:01:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:01:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:01:38 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Flow 'volume_create_manager' (99ce40d2-8e7f-4720-b5a6-421b083cb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f646e12-ed8b-4c6a-8ceb-55872855494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f646e12-ed8b-4c6a-8ceb-55872855494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-810645046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36aef68c-4be9-46fa-9606-05510dbfeda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82b67d7baac4003a8912c16bb6dc164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:01:38Z,use_quota=True,user_id='731691abeca243d5ae67b252f8701553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c099c0-d832-4225-b94d-11dd8cecaa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c099c0-d832-4225-b94d-11dd8cecaa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410d2643-6178-4086-a51a-500440257573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410d2643-6178-4086-a51a-500440257573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36aef68c-4be9-46fa-9606-05510dbfeda8', 'volume_name': 'volume-36aef68c-4be9-46fa-9606-05510dbfeda8', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e5e889-614e-4263-9040-dfd6357bf53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e5e889-614e-4263-9040-dfd6357bf53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bf0051-7a00-44f3-8361-a8bba10b01b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:38 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume 36aef68c-4be9-46fa-9606-05510dbfeda8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36aef68c-4be9-46fa-9606-05510dbfeda8', 'volume_size': 1}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-810645046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36aef68c-4be9-46fa-9606-05510dbfeda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82b67d7baac4003a8912c16bb6dc164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:01:38Z,use_quota=True,user_id='731691abeca243d5ae67b252f8701553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Creating volume 36aef68c-4be9-46fa-9606-05510dbfeda8 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:01:38 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:01:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:01:38 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=144, name=volume-36aef68c-4be9-46fa-9606-05510dbfeda8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:01:39 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Flow 'volume_create_manager' (c23e84eb-40f2-48f3-b463-64a2d09f4d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a878e7-bb01-4aa1-bbdc-25fd32a0eec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a878e7-bb01-4aa1-bbdc-25fd32a0eec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-18155471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e152eca-8ccd-4a3e-a2ba-f88d52701ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82b67d7baac4003a8912c16bb6dc164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:01:39Z,use_quota=True,user_id='731691abeca243d5ae67b252f8701553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065a39dd-dfa7-4746-b963-29d2afc8c9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065a39dd-dfa7-4746-b963-29d2afc8c9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1f4b14-1486-4584-96a4-6d2203ebcce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1f4b14-1486-4584-96a4-6d2203ebcce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e152eca-8ccd-4a3e-a2ba-f88d52701ab8', 'volume_name': 'volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12964ce1-c694-457d-a576-cac2effc27ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12964ce1-c694-457d-a576-cac2effc27ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fcad6c-08e8-45de-b486-acc9dc15b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:39 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume 7e152eca-8ccd-4a3e-a2ba-f88d52701ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8', 'volume_size': 1}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8 1073741824" returned: 0 in 0.784s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8" returned: 0 in 0.135s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] <== create_volume: return (987ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-18155471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e152eca-8ccd-4a3e-a2ba-f88d52701ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82b67d7baac4003a8912c16bb6dc164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:01:39Z,use_quota=True,user_id='731691abeca243d5ae67b252f8701553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Creating volume 7e152eca-8ccd-4a3e-a2ba-f88d52701ab8 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:01:39 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:01:39 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=145, name=volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bf0051-7a00-44f3-8361-a8bba10b01b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36aef68c-4be9-46fa-9606-05510dbfeda8', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:39 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b408da-245b-4fa2-b47b-ac08708977a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:40 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume volume-36aef68c-4be9-46fa-9606-05510dbfeda8 (36aef68c-4be9-46fa-9606-05510dbfeda8): created successfully
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b408da-245b-4fa2-b47b-ac08708977a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Flow 'volume_create_manager' (99ce40d2-8e7f-4720-b5a6-421b083cb03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8 1073741824" returned: 0 in 0.496s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:01:40 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bcb27c51-5714-4a5e-af1f-0cb5918f5bcc tempest-TestServerVolumeAttachmentScenario-1623962718 None] Created volume successfully.
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8" returned: 0 in 0.288s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] <== create_volume: return (815ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fcad6c-08e8-45de-b486-acc9dc15b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cde6abf-6aa1-4c28-a0f2-4a8f8af47580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:01:40 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8 (7e152eca-8ccd-4a3e-a2ba-f88d52701ab8): created successfully
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cde6abf-6aa1-4c28-a0f2-4a8f8af47580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:01:40 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Flow 'volume_create_manager' (c23e84eb-40f2-48f3-b463-64a2d09f4d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:01:40 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-836ee0a7-c0db-4beb-b808-38391cb1c32d tempest-TestServerVolumeAttachmentScenario-1623962718 None] Created volume successfully.
Sep 18 14:01:50 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:01:50 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:02:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 14:02:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:02:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:02:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:02:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:02:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:02:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:02:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.086s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:02:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:03:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 14:03:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:03:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:03:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:03:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:03:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:03:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:03:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.079s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:03:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:03:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-17189193-c037-42f6-aa93-1cad36165599 req-462c7fac-94c2-4081-b558-8373ae6d05ae tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:03:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-17189193-c037-42f6-aa93-1cad36165599 req-462c7fac-94c2-4081-b558-8373ae6d05ae tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:03:16 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deba85d-6912-48a0-a309-e6fef93d7f56]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:03:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-17189193-c037-42f6-aa93-1cad36165599 req-462c7fac-94c2-4081-b558-8373ae6d05ae tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:03:16 devstack quobyte-client[82822]: System call of process 101039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:03:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-17189193-c037-42f6-aa93-1cad36165599 req-462c7fac-94c2-4081-b558-8373ae6d05ae tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8" returned: 0 in 0.439s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:03:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-17189193-c037-42f6-aa93-1cad36165599 req-462c7fac-94c2-4081-b558-8373ae6d05ae tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.500s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:03:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-17189193-c037-42f6-aa93-1cad36165599 req-462c7fac-94c2-4081-b558-8373ae6d05ae tempest-TestServerVolumeAttachmentScenario-1623962718 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-36aef68c-4be9-46fa-9606-05510dbfeda8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7c11fda-e1b1-48c8-9047-523218bd5b00', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 14:03:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-17189193-c037-42f6-aa93-1cad36165599 req-462c7fac-94c2-4081-b558-8373ae6d05ae tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:03:17 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-17189193-c037-42f6-aa93-1cad36165599 req-462c7fac-94c2-4081-b558-8373ae6d05ae tempest-TestServerVolumeAttachmentScenario-1623962718 None] attachment_update completed successfully.
Sep 18 14:03:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:03:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:03:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-7ebff5e1-a142-4acd-9956-33e222b6e9cd req-cac46eb9-01eb-4586-9874-ea7922cfe623 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:03:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-7ebff5e1-a142-4acd-9956-33e222b6e9cd req-cac46eb9-01eb-4586-9874-ea7922cfe623 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:03:29 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9d98f-1cd1-4c96-baf4-a6ed7798ca37]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:03:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7ebff5e1-a142-4acd-9956-33e222b6e9cd req-cac46eb9-01eb-4586-9874-ea7922cfe623 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:03:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [req-7ebff5e1-a142-4acd-9956-33e222b6e9cd req-cac46eb9-01eb-4586-9874-ea7922cfe623 tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8" returned: 0 in 0.423s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:03:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [req-7ebff5e1-a142-4acd-9956-33e222b6e9cd req-cac46eb9-01eb-4586-9874-ea7922cfe623 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.469s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:03:29 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-7ebff5e1-a142-4acd-9956-33e222b6e9cd req-cac46eb9-01eb-4586-9874-ea7922cfe623 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101', 'name': 'volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08810238-3aef-471f-9e37-043230449ea2', 'enforce_multipath': True} {{(pid=82799) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 14:03:29 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-7ebff5e1-a142-4acd-9956-33e222b6e9cd req-cac46eb9-01eb-4586-9874-ea7922cfe623 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:03:29 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-7ebff5e1-a142-4acd-9956-33e222b6e9cd req-cac46eb9-01eb-4586-9874-ea7922cfe623 tempest-TestServerVolumeAttachmentScenario-1623962718 None] attachment_update completed successfully.
Sep 18 14:03:39 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:03:39 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:03:56 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-d32701fb-2d8a-4597-a6cd-29fce17402ba req-a4c9be25-ccca-44d9-afee-83e7e9618e52 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:03:56 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-d32701fb-2d8a-4597-a6cd-29fce17402ba req-a4c9be25-ccca-44d9-afee-83e7e9618e52 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:03:56 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-d32701fb-2d8a-4597-a6cd-29fce17402ba req-a4c9be25-ccca-44d9-afee-83e7e9618e52 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Terminate volume connection completed successfully.
Sep 18 14:03:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-d32701fb-2d8a-4597-a6cd-29fce17402ba req-a4c9be25-ccca-44d9-afee-83e7e9618e52 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Deleting attachment 08810238-3aef-471f-9e37-043230449ea2. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 14:04:06 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:04:06 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:04:12 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 14:04:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:04:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:04:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:04:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:04:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:04:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:04:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.082s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:04:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:04:20 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-21222d31-749f-4e43-aefe-d94a2dd501f3 req-19375348-de17-4e91-9786-a41d0282503f tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:04:20 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [req-21222d31-749f-4e43-aefe-d94a2dd501f3 req-19375348-de17-4e91-9786-a41d0282503f tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:04:20 devstack cinder-volume[82799]: INFO cinder.volume.manager [req-21222d31-749f-4e43-aefe-d94a2dd501f3 req-19375348-de17-4e91-9786-a41d0282503f tempest-TestServerVolumeAttachmentScenario-1623962718 None] Terminate volume connection completed successfully.
Sep 18 14:04:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [req-21222d31-749f-4e43-aefe-d94a2dd501f3 req-19375348-de17-4e91-9786-a41d0282503f tempest-TestServerVolumeAttachmentScenario-1623962718 None] Deleting attachment b7c11fda-e1b1-48c8-9047-523218bd5b00. {{(pid=82799) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 14:04:30 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:04:30 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:04:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "cinder-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:04:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "cinder-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:04:33 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "cinder-quobyte-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "cinder-quobyte-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8" acquired by "delete_volume" :: waited 0.011s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9448ecef-142a-49a9-a8ee-50a1cec6014a]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8" returned: 0 in 0.391s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8" returned: 0 in 0.092s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "cinder-quobyte-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8" released by "delete_volume" :: held 0.615s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Created reservations ['01fbf662-e269-4215-b443-a3cb51415d44', '038e8e8e-c347-415a-9bcb-b91e52fafee9', 'c1991b0a-2892-4caf-90c2-d4e8172338ea', '3b6625ff-53ec-44e2-bdb8-b4a24c38c06e'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:04:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "cinder-36aef68c-4be9-46fa-9606-05510dbfeda8-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.276s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:04:34 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Deleted volume successfully.
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "cinder-36aef68c-4be9-46fa-9606-05510dbfeda8-delete_volume" acquired by "delete_volume" :: waited 0.196s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0b5a42eb-e94e-4294-842c-17e667d8cff2 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "cinder-7e152eca-8ccd-4a3e-a2ba-f88d52701ab8-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:04:34 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "cinder-quobyte-36aef68c-4be9-46fa-9606-05510dbfeda8" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "cinder-quobyte-36aef68c-4be9-46fa-9606-05510dbfeda8" acquired by "delete_volume" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aabf629-e686-462b-a1ef-66a0e98d496e]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8" returned: 0 in 0.376s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:04:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:04:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-36aef68c-4be9-46fa-9606-05510dbfeda8" returned: 0 in 0.102s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:04:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "cinder-quobyte-36aef68c-4be9-46fa-9606-05510dbfeda8" released by "delete_volume" :: held 0.616s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:04:35 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Created reservations ['aa6959ea-5c95-4433-9db3-e369f9991822', 'dccbfa78-271e-4d68-963b-f74bdfc92016', '24365edd-551e-4ccd-9d29-6373e624f04d', 'c1601a5b-80d2-4af7-990d-586d7b88da57'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:04:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:04:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:04:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:04:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:04:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:04:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:04:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.137s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:04:36 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:04:36 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Deleted volume successfully.
Sep 18 14:04:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2aba4dd3-89e5-4492-b590-f92312e78e42 tempest-TestServerVolumeAttachmentScenario-1623962718 None] Lock "cinder-36aef68c-4be9-46fa-9606-05510dbfeda8-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:04:45 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=20,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:04:46 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:05:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (41607f9c-e217-4d7b-a233-958b0fb06b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30eb9d04-0e53-4e75-8086-1753bea0703b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:09 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (f4183e2b-a08b-4214-aeec-af41db7f0119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b090365a-f850-410b-9258-0bac32d5c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30eb9d04-0e53-4e75-8086-1753bea0703b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1664275426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f99fd8-7754-43f1-994b-ba21de0ef6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:09Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9790fb6-8c0b-42e8-be30-143d71b1293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9790fb6-8c0b-42e8-be30-143d71b1293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16dde90a-e23c-408b-be28-a3f07b10cc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16dde90a-e23c-408b-be28-a3f07b10cc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f99fd8-7754-43f1-994b-ba21de0ef6e7', 'volume_name': 'volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c3f74f-239e-4c56-9004-aba7985d86b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c3f74f-239e-4c56-9004-aba7985d86b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077d4938-23ec-42af-b153-8da6dd9c5d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:09 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume f7f99fd8-7754-43f1-994b-ba21de0ef6e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7', 'volume_size': 1}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1664275426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f99fd8-7754-43f1-994b-ba21de0ef6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:09Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Creating volume f7f99fd8-7754-43f1-994b-ba21de0ef6e7 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:09 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:09 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=146, name=volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b090365a-f850-410b-9258-0bac32d5c433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1509319775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6690925-75d7-48d9-bc14-8cd43b089817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:09Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0c1d1e-3692-4679-8989-d43cacd7d956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0c1d1e-3692-4679-8989-d43cacd7d956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd7589d-ba21-4fad-831f-152a697704aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd7589d-ba21-4fad-831f-152a697704aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6690925-75d7-48d9-bc14-8cd43b089817', 'volume_name': 'volume-b6690925-75d7-48d9-bc14-8cd43b089817', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eee40fa-ffd8-4041-842f-abfaed35968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eee40fa-ffd8-4041-842f-abfaed35968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9857e4-85cd-4bef-9a9c-a5939e47722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:10 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Volume b6690925-75d7-48d9-bc14-8cd43b089817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6690925-75d7-48d9-bc14-8cd43b089817', 'volume_size': 1}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7 1073741824" returned: 0 in 0.828s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:10 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (21bac14c-a01d-4a3b-af8e-078a1363b157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445975c6-e281-44b7-a3ef-56a38ca36f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445975c6-e281-44b7-a3ef-56a38ca36f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1677887115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a6a99f-7cb9-4b64-abc3-20c3bedd9b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:10Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec53b3d4-7b00-4452-a816-1c019f1b7f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec53b3d4-7b00-4452-a816-1c019f1b7f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5f7328-d260-4b96-8019-499f3c134e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5f7328-d260-4b96-8019-499f3c134e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a6a99f-7cb9-4b64-abc3-20c3bedd9b61', 'volume_name': 'volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e0e60c-557c-4c85-8aaf-224bd731ce6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e0e60c-557c-4c85-8aaf-224bd731ce6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dbea57-41e1-4ba9-a5e4-f60f91c496e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Volume 57a6a99f-7cb9-4b64-abc3-20c3bedd9b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61', 'volume_size': 1}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7" returned: 0 in 0.787s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] <== create_volume: return (1664ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.853s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1509319775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6690925-75d7-48d9-bc14-8cd43b089817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:09Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Creating volume b6690925-75d7-48d9-bc14-8cd43b089817 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:11 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b6690925-75d7-48d9-bc14-8cd43b089817 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:11 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:11 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=147, name=volume-b6690925-75d7-48d9-bc14-8cd43b089817, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (6894996f-c40e-4999-baae-0dcc7833b75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066cac46-0034-48f3-81b8-f089922740ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (61a9851e-42f7-4d21-8a30-26adc0f3728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847c1f5c-032b-4778-ad76-3829436cf4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847c1f5c-032b-4778-ad76-3829436cf4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527489741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00b327f-4171-4b3b-a8d9-dcf7463d0d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:11Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162f88ea-4b91-40ea-b055-dea58f7e81f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162f88ea-4b91-40ea-b055-dea58f7e81f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed3fd9b-4d7f-484f-a69f-afc41f632d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed3fd9b-4d7f-484f-a69f-afc41f632d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b00b327f-4171-4b3b-a8d9-dcf7463d0d7e', 'volume_name': 'volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecad55e-56f0-43ce-b890-e8c386cff32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecad55e-56f0-43ce-b890-e8c386cff32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4887a2ca-912f-416e-a15e-ae3a84dc25ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Volume b00b327f-4171-4b3b-a8d9-dcf7463d0d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e', 'volume_size': 1}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077d4938-23ec-42af-b153-8da6dd9c5d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea7e524-f9ff-4be1-8b1e-28b99b716f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066cac46-0034-48f3-81b8-f089922740ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-580915025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf170541-60d6-4e47-9763-4fa89db14232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:10Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7862eaff-6613-4141-97f2-c33bae7ceb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7862eaff-6613-4141-97f2-c33bae7ceb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baca0520-70f9-4d1d-9eb8-a8c5a250c402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baca0520-70f9-4d1d-9eb8-a8c5a250c402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf170541-60d6-4e47-9763-4fa89db14232', 'volume_name': 'volume-bf170541-60d6-4e47-9763-4fa89db14232', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d0892a-1021-4007-b81c-5e02269cd763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d0892a-1021-4007-b81c-5e02269cd763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53091d1-dc80-450d-99d7-c5c680e4a6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Volume bf170541-60d6-4e47-9763-4fa89db14232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf170541-60d6-4e47-9763-4fa89db14232', 'volume_size': 1}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7 (f7f99fd8-7754-43f1-994b-ba21de0ef6e7): created successfully
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea7e524-f9ff-4be1-8b1e-28b99b716f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (41607f9c-e217-4d7b-a233-958b0fb06b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b6690925-75d7-48d9-bc14-8cd43b089817 1073741824" returned: 0 in 0.835s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b6690925-75d7-48d9-bc14-8cd43b089817 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:12 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bf0addf8-a579-4240-9d4b-7be3f70536be tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created volume successfully.
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b6690925-75d7-48d9-bc14-8cd43b089817" returned: 0 in 0.353s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] <== create_volume: return (1212ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.294s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1677887115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a6a99f-7cb9-4b64-abc3-20c3bedd9b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:10Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Creating volume 57a6a99f-7cb9-4b64-abc3-20c3bedd9b61 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:12 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:12 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:12 devstack quobyte-client[82822]: System call of process 101755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:05:12 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=148, name=volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (c1bf358f-d746-4a39-847e-983bef019146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9cf887-dc2b-436e-9583-750defc6bc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9cf887-dc2b-436e-9583-750defc6bc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-821999098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2347ca-eada-4d73-88f5-fd60b5949eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:12Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c475317d-cd87-4c28-9233-90f615e3686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c475317d-cd87-4c28-9233-90f615e3686a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e028cf10-b2b0-4c90-8bb2-008e868e0d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e028cf10-b2b0-4c90-8bb2-008e868e0d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2347ca-eada-4d73-88f5-fd60b5949eaf', 'volume_name': 'volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb1d2b2-b395-4e89-a337-aeaed6b03d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb1d2b2-b395-4e89-a337-aeaed6b03d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885184c3-ef2e-4c4a-92ad-9add705f3662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:13 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Volume cb2347ca-eada-4d73-88f5-fd60b5949eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf', 'volume_size': 1}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9857e4-85cd-4bef-9a9c-a5939e47722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6690925-75d7-48d9-bc14-8cd43b089817', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbeb938-047d-4b2b-8f21-6b1a1b24771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:13 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Volume volume-b6690925-75d7-48d9-bc14-8cd43b089817 (b6690925-75d7-48d9-bc14-8cd43b089817): created successfully
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbeb938-047d-4b2b-8f21-6b1a1b24771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (f4183e2b-a08b-4214-aeec-af41db7f0119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61 1073741824" returned: 0 in 1.510s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:14 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (0a1dd69e-855e-4b8a-a713-fa95f9a29696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4731d6c-61e9-4465-9388-59d76c85a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (7506e0d6-68c2-4336-b506-449c6a8c90a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff45b6f6-9d03-46ab-9887-a3f5767e17c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 1.543s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:14 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e490e439-8e45-4727-818d-d2de7e1669df tempest-CreateVolumesFromImageTest-485715184 None] Created volume successfully.
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4731d6c-61e9-4465-9388-59d76c85a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221841096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605e68af-d6fa-43f8-97cd-3394b098c871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:14Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa20928d-16de-4eba-9458-730b4963f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa20928d-16de-4eba-9458-730b4963f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5995a05b-6159-4dc3-9558-e76275fdc5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5995a05b-6159-4dc3-9558-e76275fdc5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605e68af-d6fa-43f8-97cd-3394b098c871', 'volume_name': 'volume-605e68af-d6fa-43f8-97cd-3394b098c871', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44548d95-39fd-438f-820a-f2726d1ffdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44548d95-39fd-438f-820a-f2726d1ffdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b929f841-31a7-4986-9b98-80ea85c2a213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume 605e68af-d6fa-43f8-97cd-3394b098c871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605e68af-d6fa-43f8-97cd-3394b098c871', 'volume_size': 1}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61" returned: 0 in 0.890s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] <== create_volume: return (2445ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.458s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff45b6f6-9d03-46ab-9887-a3f5767e17c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666389859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e825982-6404-47f5-b1e9-00030bc704a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:13Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787577ac-889e-40e8-9145-26e8ec039f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787577ac-889e-40e8-9145-26e8ec039f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ae3168-7139-4c4e-bcfd-4a8dd8671c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ae3168-7139-4c4e-bcfd-4a8dd8671c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e825982-6404-47f5-b1e9-00030bc704a6', 'volume_name': 'volume-4e825982-6404-47f5-b1e9-00030bc704a6', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f29fc1-3d91-4cb0-9a24-a97d1121b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f29fc1-3d91-4cb0-9a24-a97d1121b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dda3ac9-589d-46ac-a866-7c9ee6b39560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:14 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume 4e825982-6404-47f5-b1e9-00030bc704a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e825982-6404-47f5-b1e9-00030bc704a6', 'volume_size': 1}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666389859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e825982-6404-47f5-b1e9-00030bc704a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:13Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Creating volume 4e825982-6404-47f5-b1e9-00030bc704a6 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:14 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4e825982-6404-47f5-b1e9-00030bc704a6 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:15 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=149, name=volume-4e825982-6404-47f5-b1e9-00030bc704a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dbea57-41e1-4ba9-a5e4-f60f91c496e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f673d6f6-3040-4d33-aa97-8a9fad0518d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:15 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:15 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (4d03f5f7-8e9b-466f-bbf5-92a87ad11cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee5811a-976c-4f8b-940c-5557144d5c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:15 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Volume volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61 (57a6a99f-7cb9-4b64-abc3-20c3bedd9b61): created successfully
Sep 18 14:05:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f673d6f6-3040-4d33-aa97-8a9fad0518d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (21bac14c-a01d-4a3b-af8e-078a1363b157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4e825982-6404-47f5-b1e9-00030bc704a6 1073741824" returned: 0 in 0.819s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4e825982-6404-47f5-b1e9-00030bc704a6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (2487f2f5-839d-47d0-9bfb-c2b5868ff5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306111af-459f-4b62-8310-c47cb9e97623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee5811a-976c-4f8b-940c-5557144d5c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561402727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef954d2-9dfe-4431-845e-d11f564721bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:14Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1582324b-2d4d-48c8-a40b-4455d4d22958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1582324b-2d4d-48c8-a40b-4455d4d22958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f536285-77d4-406c-a1e5-0c2998d2130d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f536285-77d4-406c-a1e5-0c2998d2130d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef954d2-9dfe-4431-845e-d11f564721bf', 'volume_name': 'volume-4ef954d2-9dfe-4431-845e-d11f564721bf', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b238c1-e2ad-4afb-8c46-9f6d58a6d1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b238c1-e2ad-4afb-8c46-9f6d58a6d1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813d6b5d-fb09-4848-bd4d-0fbcd8624ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume 4ef954d2-9dfe-4431-845e-d11f564721bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef954d2-9dfe-4431-845e-d11f564721bf', 'volume_size': 1}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:16 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-aa31fded-ce00-44ad-bcab-c565e662ff67 tempest-CreateVolumesFromImageTest-485715184 None] Created volume successfully.
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306111af-459f-4b62-8310-c47cb9e97623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337674774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2624389-f436-4912-92d7-2f9b64086d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:15Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa4b1e9-e00b-4462-aa13-29ee9a8595dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa4b1e9-e00b-4462-aa13-29ee9a8595dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b558397c-94c3-432a-96ac-55761a65d795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b558397c-94c3-432a-96ac-55761a65d795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2624389-f436-4912-92d7-2f9b64086d54', 'volume_name': 'volume-a2624389-f436-4912-92d7-2f9b64086d54', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56216635-7181-4bf3-b788-94bc0eeaef44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56216635-7181-4bf3-b788-94bc0eeaef44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ab24d7-a04c-44eb-b2af-95a618767e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume a2624389-f436-4912-92d7-2f9b64086d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2624389-f436-4912-92d7-2f9b64086d54', 'volume_size': 1}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4e825982-6404-47f5-b1e9-00030bc704a6" returned: 0 in 0.656s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] <== create_volume: return (1496ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.505s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-580915025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf170541-60d6-4e47-9763-4fa89db14232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:10Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Creating volume bf170541-60d6-4e47-9763-4fa89db14232 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:16 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bf170541-60d6-4e47-9763-4fa89db14232 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:16 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=150, name=volume-bf170541-60d6-4e47-9763-4fa89db14232, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dda3ac9-589d-46ac-a866-7c9ee6b39560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e825982-6404-47f5-b1e9-00030bc704a6', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7185748b-7631-431e-9028-8d6089fdd4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:16 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:16 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (beacb76a-3332-4e9f-9bfb-4f3bdb87f222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4408074-cfcc-44ed-80e0-cbe6d97e7575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4408074-cfcc-44ed-80e0-cbe6d97e7575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1877259042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be35ff62-32d1-4f90-9a8c-ab4e7942de99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:16Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9617486-edc4-4fc8-869c-2ce2c1b9e2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9617486-edc4-4fc8-869c-2ce2c1b9e2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185dd5d4-7cb9-4498-9114-77ca5478fa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185dd5d4-7cb9-4498-9114-77ca5478fa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be35ff62-32d1-4f90-9a8c-ab4e7942de99', 'volume_name': 'volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcc4c8b-725a-4b8f-8f4a-c8b8fc6fb6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcc4c8b-725a-4b8f-8f4a-c8b8fc6fb6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbdaa675-673f-49c9-9c54-913649539cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:17 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume be35ff62-32d1-4f90-9a8c-ab4e7942de99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99', 'volume_size': 1}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:17 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume volume-4e825982-6404-47f5-b1e9-00030bc704a6 (4e825982-6404-47f5-b1e9-00030bc704a6): created successfully
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7185748b-7631-431e-9028-8d6089fdd4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (7506e0d6-68c2-4336-b506-449c6a8c90a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bf170541-60d6-4e47-9763-4fa89db14232 1073741824" returned: 0 in 0.743s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bf170541-60d6-4e47-9763-4fa89db14232 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:17 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8ad900ee-e70c-4f7c-8006-9d3f01ffca96 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created volume successfully.
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bf170541-60d6-4e47-9763-4fa89db14232" returned: 0 in 0.261s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] <== create_volume: return (1024ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.745s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-821999098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2347ca-eada-4d73-88f5-fd60b5949eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:12Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Creating volume cb2347ca-eada-4d73-88f5-fd60b5949eaf {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:17 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:17 devstack quobyte-client[82822]: System call of process 101768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:05:17 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=151, name=volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53091d1-dc80-450d-99d7-c5c680e4a6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf170541-60d6-4e47-9763-4fa89db14232', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:17 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e94c97-e1dd-499d-8ea5-7996b8ef51ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf 1073741824" returned: 0 in 0.658s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:18 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Volume volume-bf170541-60d6-4e47-9763-4fa89db14232 (bf170541-60d6-4e47-9763-4fa89db14232): created successfully
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e94c97-e1dd-499d-8ea5-7996b8ef51ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (6894996f-c40e-4999-baae-0dcc7833b75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf" returned: 0 in 0.456s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] <== create_volume: return (1157ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.902s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221841096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605e68af-d6fa-43f8-97cd-3394b098c871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:14Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Creating volume 605e68af-d6fa-43f8-97cd-3394b098c871 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:18 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-605e68af-d6fa-43f8-97cd-3394b098c871 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:18 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-cea3f81c-dec0-44e9-ace6-1e4e6fbc75bc tempest-CreateVolumesFromImageTest-485715184 None] Created volume successfully.
Sep 18 14:05:18 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=152, name=volume-605e68af-d6fa-43f8-97cd-3394b098c871, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885184c3-ef2e-4c4a-92ad-9add705f3662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1cba48-da3d-49af-baf8-7289b6316191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:19 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Volume volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf (cb2347ca-eada-4d73-88f5-fd60b5949eaf): created successfully
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1cba48-da3d-49af-baf8-7289b6316191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (c1bf358f-d746-4a39-847e-983bef019146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-605e68af-d6fa-43f8-97cd-3394b098c871 1073741824" returned: 0 in 0.520s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-605e68af-d6fa-43f8-97cd-3394b098c871 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:19 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4ddb0440-dd3b-4e76-ad5f-c1bb29d6c2c3 tempest-CreateVolumesFromImageTest-485715184 None] Created volume successfully.
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-605e68af-d6fa-43f8-97cd-3394b098c871" returned: 0 in 0.390s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] <== create_volume: return (945ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.848s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527489741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00b327f-4171-4b3b-a8d9-dcf7463d0d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f7cf702aed43b18f7f10626dc86c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:11Z,use_quota=True,user_id='db21207f8f4c448aab42c73528d30d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Creating volume b00b327f-4171-4b3b-a8d9-dcf7463d0d7e {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:19 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:19 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=153, name=volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b929f841-31a7-4986-9b98-80ea85c2a213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605e68af-d6fa-43f8-97cd-3394b098c871', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75e1a95-f2a8-4678-ac34-1b2482be610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:20 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume volume-605e68af-d6fa-43f8-97cd-3394b098c871 (605e68af-d6fa-43f8-97cd-3394b098c871): created successfully
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75e1a95-f2a8-4678-ac34-1b2482be610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (0a1dd69e-855e-4b8a-a713-fa95f9a29696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e 1073741824" returned: 0 in 0.517s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:20 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-578cebaf-d713-4696-8ab1-f65539503b3b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created volume successfully.
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e" returned: 0 in 0.286s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] <== create_volume: return (833ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.308s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561402727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef954d2-9dfe-4431-845e-d11f564721bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:14Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Creating volume 4ef954d2-9dfe-4431-845e-d11f564721bf {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:20 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4ef954d2-9dfe-4431-845e-d11f564721bf 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:20 devstack quobyte-client[82822]: System call of process 101780 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:05:20 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=154, name=volume-4ef954d2-9dfe-4431-845e-d11f564721bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4887a2ca-912f-416e-a15e-ae3a84dc25ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:20 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40759ae-1384-4663-b5fa-d06473a72267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4ef954d2-9dfe-4431-845e-d11f564721bf 1073741824" returned: 0 in 0.483s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4ef954d2-9dfe-4431-845e-d11f564721bf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:21 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Volume volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e (b00b327f-4171-4b3b-a8d9-dcf7463d0d7e): created successfully
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40759ae-1384-4663-b5fa-d06473a72267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Flow 'volume_create_manager' (61a9851e-42f7-4d21-8a30-26adc0f3728e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4ef954d2-9dfe-4431-845e-d11f564721bf" returned: 0 in 0.372s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] <== create_volume: return (889ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.130s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337674774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2624389-f436-4912-92d7-2f9b64086d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:15Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Creating volume a2624389-f436-4912-92d7-2f9b64086d54 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:21 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a2624389-f436-4912-92d7-2f9b64086d54 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:21 devstack quobyte-client[82822]: System call of process 101784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:05:21 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=155, name=volume-a2624389-f436-4912-92d7-2f9b64086d54, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:22 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-084eee57-6471-4f05-acb5-63252a9d5f8a tempest-CreateVolumesFromImageTest-485715184 None] Created volume successfully.
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813d6b5d-fb09-4848-bd4d-0fbcd8624ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef954d2-9dfe-4431-845e-d11f564721bf', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427a4465-177f-4540-9f69-061c0387581c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-cb2347ca-eada-4d73-88f5-fd60b5949eaf-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a2624389-f436-4912-92d7-2f9b64086d54 1073741824" returned: 0 in 0.800s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a2624389-f436-4912-92d7-2f9b64086d54 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:22 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume volume-4ef954d2-9dfe-4431-845e-d11f564721bf (4ef954d2-9dfe-4431-845e-d11f564721bf): created successfully
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427a4465-177f-4540-9f69-061c0387581c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (4d03f5f7-8e9b-466f-bbf5-92a87ad11cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-cb2347ca-eada-4d73-88f5-fd60b5949eaf-delete_volume" acquired by "delete_volume" :: waited 0.494s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a2624389-f436-4912-92d7-2f9b64086d54" returned: 0 in 0.468s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] <== create_volume: return (1300ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.715s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1877259042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be35ff62-32d1-4f90-9a8c-ab4e7942de99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28511127c9d4d34ae7e346c7557582a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:16Z,use_quota=True,user_id='3d67d3e25a3f4795adf9b230b2358d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Creating volume be35ff62-32d1-4f90-9a8c-ab4e7942de99 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:22 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:23 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e88c49d3-e0bb-4148-b31a-5c8cf6df7c6d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created volume successfully.
Sep 18 14:05:23 devstack quobyte-client[82822]: System call of process 101789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:05:23 devstack quobyte-client[82822]: System call of process 101789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:05:23 devstack quobyte-client[82822]: System call of process 101789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:05:23 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=156, name=volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ab24d7-a04c-44eb-b2af-95a618767e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2624389-f436-4912-92d7-2f9b64086d54', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0053fdd-fe44-4dcb-b378-8100c0191a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99 1073741824" returned: 0 in 0.563s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:23 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume volume-a2624389-f436-4912-92d7-2f9b64086d54 (a2624389-f436-4912-92d7-2f9b64086d54): created successfully
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0053fdd-fe44-4dcb-b378-8100c0191a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (2487f2f5-839d-47d0-9bfb-c2b5868ff5d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:23 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-5292dfa7-9950-45b2-a018-3b93b4e9fd42 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created volume successfully.
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99" returned: 0 in 0.479s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] <== create_volume: return (1086ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:23 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-quobyte-cb2347ca-eada-4d73-88f5-fd60b5949eaf" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:24 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-cb2347ca-eada-4d73-88f5-fd60b5949eaf" acquired by "delete_volume" :: waited 0.050s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbdaa675-673f-49c9-9c54-913649539cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dc1fb7-8d57-48f7-8f42-85542fd6da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:24 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c43cf-0143-4ef0-8ea1-79c345b8ffb1]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:24 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99 (be35ff62-32d1-4f90-9a8c-ab4e7942de99): created successfully
Sep 18 14:05:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dc1fb7-8d57-48f7-8f42-85542fd6da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Flow 'volume_create_manager' (beacb76a-3332-4e9f-9bfb-4f3bdb87f222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:24 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-be35ff62-32d1-4f90-9a8c-ab4e7942de99-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:24 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-61552527-807f-49e1-b083-0f72262d76a0 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created volume successfully.
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf" returned: 0 in 0.955s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-be35ff62-32d1-4f90-9a8c-ab4e7942de99-delete_volume" acquired by "delete_volume" :: waited 0.253s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-cb2347ca-eada-4d73-88f5-fd60b5949eaf" returned: 0 in 0.404s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-cb2347ca-eada-4d73-88f5-fd60b5949eaf" released by "delete_volume" :: held 1.491s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:25 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-quobyte-be35ff62-32d1-4f90-9a8c-ab4e7942de99" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-be35ff62-32d1-4f90-9a8c-ab4e7942de99" acquired by "delete_volume" :: waited 0.101s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Created reservations ['f54c8d81-3e8b-450d-bdb7-26a114d9e369', 'f70f2aca-5e88-4100-9bb7-1a7a267272ec', 'b6457d2d-8f5a-46aa-9145-5ea98e784100', '04cb2e19-09a6-4f8d-aaf5-6a44493c032a'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[27113852-df80-45eb-b82c-9e27eff184ca]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99" returned: 0 in 0.760s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.260s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:26 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Deleted volume successfully.
Sep 18 14:05:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-be35ff62-32d1-4f90-9a8c-ab4e7942de99" returned: 0 in 0.338s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-be35ff62-32d1-4f90-9a8c-ab4e7942de99" released by "delete_volume" :: held 1.243s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-2fd67931-6afe-4e9a-a185-3efe57b4be12 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-cb2347ca-eada-4d73-88f5-fd60b5949eaf-delete_volume" released by "delete_volume" :: held 4.431s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:27 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-quobyte-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:27 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created reservations ['7a43dd51-ce56-404e-8230-6d37ca653cfb', '174443ed-cd59-423b-bbc8-9d04dadcc4c5', '20fb54e2-abf2-4475-aa5c-5fa1b83ac657', '914c0f0b-cdca-4bcc-bcac-3a1c8b973d18'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e" acquired by "delete_volume" :: waited 0.034s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:27 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf096efb-40fb-4f3b-9d18-8f2d6a21b775]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e" returned: 0 in 0.585s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-a2624389-f436-4912-92d7-2f9b64086d54-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e" returned: 0 in 0.564s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.423s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:28 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Deleted volume successfully.
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-a2624389-f436-4912-92d7-2f9b64086d54-delete_volume" acquired by "delete_volume" :: waited 0.300s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:28 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e" released by "delete_volume" :: held 1.458s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-d6891045-79e3-43a1-a9e5-35121f22144d tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-be35ff62-32d1-4f90-9a8c-ab4e7942de99-delete_volume" released by "delete_volume" :: held 3.822s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:29 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-quobyte-a2624389-f436-4912-92d7-2f9b64086d54" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-a2624389-f436-4912-92d7-2f9b64086d54" acquired by "delete_volume" :: waited 0.022s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Created reservations ['4849b71f-0ed6-41f5-b501-39e752aac213', '6ba6813e-2635-4c4e-936d-b8ff318437cf', 'd70bed5d-f358-4638-a6ba-f9cff296fd54', '3185871b-4959-4b13-8f27-3c2309dac90a'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4f45a4-bb94-4e1c-bc2b-3e8ac1ee200c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a2624389-f436-4912-92d7-2f9b64086d54 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:30 devstack quobyte-client[82822]: System call of process 101807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:05:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.203s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:30 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:30 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Deleted volume successfully.
Sep 18 14:05:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a2624389-f436-4912-92d7-2f9b64086d54" returned: 0 in 1.065s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a2624389-f436-4912-92d7-2f9b64086d54 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a2624389-f436-4912-92d7-2f9b64086d54" returned: 0 in 0.204s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-95f18887-a67e-4621-a142-6bb8bef5bc6b tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-b00b327f-4171-4b3b-a8d9-dcf7463d0d7e-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-a2624389-f436-4912-92d7-2f9b64086d54" released by "delete_volume" :: held 1.466s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-bf170541-60d6-4e47-9763-4fa89db14232-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-bf170541-60d6-4e47-9763-4fa89db14232-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created reservations ['76dace99-c124-4df1-adcf-9aeff363fa0d', '8c11a9fa-fc08-4de4-bdc9-4b9077044b98', '0e75870b-5e21-4925-9a4c-84fc237eee1f', '0b34ee1c-d85b-4a95-9253-2e866f4411ad'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:31 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-quobyte-bf170541-60d6-4e47-9763-4fa89db14232" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-bf170541-60d6-4e47-9763-4fa89db14232" acquired by "delete_volume" :: waited 0.030s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[67099a81-fa5a-4d9a-b685-327c852edfad]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bf170541-60d6-4e47-9763-4fa89db14232 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.048s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bf170541-60d6-4e47-9763-4fa89db14232" returned: 0 in 0.770s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bf170541-60d6-4e47-9763-4fa89db14232 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-4ef954d2-9dfe-4431-845e-d11f564721bf-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.588s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-bf170541-60d6-4e47-9763-4fa89db14232" returned: 0 in 0.388s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-4ef954d2-9dfe-4431-845e-d11f564721bf-delete_volume" acquired by "delete_volume" :: waited 0.189s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:32 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Deleted volume successfully.
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-bf170541-60d6-4e47-9763-4fa89db14232" released by "delete_volume" :: held 1.431s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:32 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-quobyte-4ef954d2-9dfe-4431-845e-d11f564721bf" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-4ef954d2-9dfe-4431-845e-d11f564721bf" acquired by "delete_volume" :: waited 0.041s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-c0eba8e8-39c8-429e-b8a1-966932806fb4 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-a2624389-f436-4912-92d7-2f9b64086d54-delete_volume" released by "delete_volume" :: held 3.963s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[089ca695-688e-4933-b238-272b645aa455]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4ef954d2-9dfe-4431-845e-d11f564721bf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Created reservations ['0bd70679-8048-4a71-a714-9fc061da88c7', '30b25312-ad58-4892-869b-1b9d11c0eaef', 'da954c0d-ea07-4f48-bbcc-df0834ad8c43', '3e031f6f-bac0-421e-8365-bfbf6065d851'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4ef954d2-9dfe-4431-845e-d11f564721bf" returned: 0 in 0.717s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4ef954d2-9dfe-4431-845e-d11f564721bf {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.225s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:33 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:33 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Deleted volume successfully.
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4ef954d2-9dfe-4431-845e-d11f564721bf" returned: 0 in 0.358s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-4ef954d2-9dfe-4431-845e-d11f564721bf" released by "delete_volume" :: held 1.195s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-b109ff65-31bd-4a54-9ff5-5707de92e0b2 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-bf170541-60d6-4e47-9763-4fa89db14232-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created reservations ['bc07924f-3bfa-45e4-a9fe-3e25152d7c9a', 'a236f5d5-87b2-4511-965e-d15116c5b91d', '74c1c938-bd8f-494b-8013-e6ae87297ef6', '049c7e85-a124-4d36-ab47-64d5f4be973b'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.263s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61-delete_volume" acquired by "delete_volume" :: waited 0.411s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:35 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Deleted volume successfully.
Sep 18 14:05:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-1d627804-24bc-4c2c-9d7e-2ea9d10346a6 tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-4ef954d2-9dfe-4431-845e-d11f564721bf-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:35 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-quobyte-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61" acquired by "delete_volume" :: waited 0.021s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:35 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e872c707-b2c0-403e-921f-0fdec9702f6d]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-605e68af-d6fa-43f8-97cd-3394b098c871-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-605e68af-d6fa-43f8-97cd-3394b098c871-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:36 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-quobyte-605e68af-d6fa-43f8-97cd-3394b098c871" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61" returned: 0 in 1.044s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61" returned: 0 in 0.290s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:36 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-605e68af-d6fa-43f8-97cd-3394b098c871" acquired by "delete_volume" :: waited 0.376s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:36 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[361620c9-84b5-4f64-a0b5-5ac99150cd6c]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-605e68af-d6fa-43f8-97cd-3394b098c871 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61" released by "delete_volume" :: held 1.680s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:37 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Created reservations ['279b7252-e51f-4da6-ae95-c733dcab1ad2', 'dbb82304-b8f8-4345-b50a-a17cb52fd60c', 'd35eeefe-f4f1-470e-83e4-8568ae9b0143', '2eed7c1d-3775-47ea-87a8-b6987689bfa8'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-605e68af-d6fa-43f8-97cd-3394b098c871" returned: 0 in 0.716s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-605e68af-d6fa-43f8-97cd-3394b098c871 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-605e68af-d6fa-43f8-97cd-3394b098c871" returned: 0 in 0.247s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-605e68af-d6fa-43f8-97cd-3394b098c871" released by "delete_volume" :: held 1.135s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-b6690925-75d7-48d9-bc14-8cd43b089817-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.573s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:38 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Deleted volume successfully.
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-b6690925-75d7-48d9-bc14-8cd43b089817-delete_volume" acquired by "delete_volume" :: waited 0.318s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-f8bfbdc9-7179-4845-be13-ea2f792fde4c tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-57a6a99f-7cb9-4b64-abc3-20c3bedd9b61-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created reservations ['f142533f-3a75-4f66-9fdd-e339b8cb12bf', 'c8d697bc-7ac7-4374-b36d-ad505b178a2e', '3c536409-6d70-4d65-890a-0c1a43a31a53', '5a7f462c-8ac2-4784-9bae-c9310119390b'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:38 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "cinder-quobyte-b6690925-75d7-48d9-bc14-8cd43b089817" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-b6690925-75d7-48d9-bc14-8cd43b089817" acquired by "delete_volume" :: waited 0.018s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1c671-03da-4789-b7c1-5b4bfcc0d8ea]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b6690925-75d7-48d9-bc14-8cd43b089817 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.234s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-4e825982-6404-47f5-b1e9-00030bc704a6-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:39 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Deleted volume successfully.
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b6690925-75d7-48d9-bc14-8cd43b089817" returned: 0 in 1.045s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b6690925-75d7-48d9-bc14-8cd43b089817 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-4e825982-6404-47f5-b1e9-00030bc704a6-delete_volume" acquired by "delete_volume" :: waited 0.493s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-b6690925-75d7-48d9-bc14-8cd43b089817" returned: 0 in 0.453s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7fad9c96-d24b-42c3-9bf1-36f0fc71d3fb tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-605e68af-d6fa-43f8-97cd-3394b098c871-delete_volume" released by "delete_volume" :: held 4.395s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-quobyte-b6690925-75d7-48d9-bc14-8cd43b089817" released by "delete_volume" :: held 1.663s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:40 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-quobyte-4e825982-6404-47f5-b1e9-00030bc704a6" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-4e825982-6404-47f5-b1e9-00030bc704a6" acquired by "delete_volume" :: waited 0.067s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:40 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb034c-bb82-4124-bac5-aec7e1aa1861]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4e825982-6404-47f5-b1e9-00030bc704a6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Created reservations ['bf481f19-bbc6-4ecf-857b-baeefb2ac586', 'cfd1814f-b714-4ab0-bd97-a5b2d6175817', '47474133-f7b3-4f8d-bb7f-e8d78ec9f008', 'adf97c16-44ba-4459-83d7-4806d4f103ed'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4e825982-6404-47f5-b1e9-00030bc704a6" returned: 0 in 0.946s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4e825982-6404-47f5-b1e9-00030bc704a6 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.352s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:41 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:42 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Deleted volume successfully.
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-4e825982-6404-47f5-b1e9-00030bc704a6" returned: 0 in 0.537s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-4e825982-6404-47f5-b1e9-00030bc704a6" released by "delete_volume" :: held 1.680s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-5b44c224-60db-4d3d-b4c3-7c35014f3c58 tempest-CreateVolumesFromImageTest-485715184 None] Lock "cinder-b6690925-75d7-48d9-bc14-8cd43b089817-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created reservations ['1fb5561e-254e-473d-8d00-de01bf004680', 'd8967088-233e-497e-b7b5-465fa8d4ef45', 'c87f3438-f800-4517-8172-cf1247040a27', '9cd5999b-fdef-4d43-988b-e496f5422e1b'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:42 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-f7f99fd8-7754-43f1-994b-ba21de0ef6e7-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.421s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:43 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-f7f99fd8-7754-43f1-994b-ba21de0ef6e7-delete_volume" acquired by "delete_volume" :: waited 0.182s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:43 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Deleted volume successfully.
Sep 18 14:05:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-763a440f-fde6-4819-9171-33461fae766b tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-4e825982-6404-47f5-b1e9-00030bc704a6-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:43 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "cinder-quobyte-f7f99fd8-7754-43f1-994b-ba21de0ef6e7" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:43 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-f7f99fd8-7754-43f1-994b-ba21de0ef6e7" acquired by "delete_volume" :: waited 0.012s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:43 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[599d32b8-559a-4b0b-9d88-cae8792d2335]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:43 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7" returned: 0 in 0.524s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:44 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-f7f99fd8-7754-43f1-994b-ba21de0ef6e7" returned: 0 in 0.139s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:44 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-quobyte-f7f99fd8-7754-43f1-994b-ba21de0ef6e7" released by "delete_volume" :: held 0.939s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Created reservations ['a354fdc9-0e82-4e39-b47a-feb73149f1a1', 'a9e1ddbd-4aab-438c-8736-e769620f45ce', '5d19c524-28e9-43d2-a000-c01d79ee975c', 'bbcf8e33-a169-4d55-bdf9-342119342665'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.207s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:05:45 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Deleted volume successfully.
Sep 18 14:05:45 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-08d86358-65e6-45a9-972f-eaa2d4506caf tempest-CreateVolumesFromSourceVolumeTest-343258227 None] Lock "cinder-f7f99fd8-7754-43f1-994b-ba21de0ef6e7-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:05:46 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Flow 'volume_create_manager' (4e2aceda-5b5b-4599-beb3-f3c9d4ba0867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a5e50a-dc36-4413-bd95-20d7d5eac489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a5e50a-dc36-4413-bd95-20d7d5eac489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-65634401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2003a4-c201-4bda-8eff-aec57b31f5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9960afac0e483f90262767cabee4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:46Z,use_quota=True,user_id='4cced1e8b3674cd58bd1fb2b988aec0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf619fda-b869-4a63-8dd2-555fe0fa3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf619fda-b869-4a63-8dd2-555fe0fa3e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17450f80-2b19-4d60-bb5c-bb5f5c5104b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17450f80-2b19-4d60-bb5c-bb5f5c5104b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2003a4-c201-4bda-8eff-aec57b31f5c5', 'volume_name': 'volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226fa28e-6a34-495f-9b26-50090d074748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226fa28e-6a34-495f-9b26-50090d074748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db13498-97cf-4c4a-9a96-d50b301d814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:46 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Volume 3d2003a4-c201-4bda-8eff-aec57b31f5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5', 'volume_size': 1}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-65634401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2003a4-c201-4bda-8eff-aec57b31f5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9960afac0e483f90262767cabee4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:46Z,use_quota=True,user_id='4cced1e8b3674cd58bd1fb2b988aec0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Creating volume 3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:46 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:46 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=157, name=volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 1073741824" returned: 0 in 0.425s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5" returned: 0 in 0.152s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] <== create_volume: return (662ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db13498-97cf-4c4a-9a96-d50b301d814a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1883f60-fc4d-4c8f-97a1-ffa1ce8286b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:47 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Volume volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 (3d2003a4-c201-4bda-8eff-aec57b31f5c5): created successfully
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1883f60-fc4d-4c8f-97a1-ffa1ce8286b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Flow 'volume_create_manager' (4e2aceda-5b5b-4599-beb3-f3c9d4ba0867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:47 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4173d372-c801-498a-a27c-7193763b0d29 tempest-SnapshotDependencyTests-403987766 None] Created volume successfully.
Sep 18 14:05:47 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (cfe43064-ce2d-4347-9019-3701ac1bf652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e515770-d5ea-4dc2-9375-7356e3f56862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e515770-d5ea-4dc2-9375-7356e3f56862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-542451464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53df8791-eb7c-463d-a4e4-369a6734699f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:48Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93865c47-8540-40dd-9193-04225b4cc939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93865c47-8540-40dd-9193-04225b4cc939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:47 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b85a49-f204-4fb8-a22e-63f620db27bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b85a49-f204-4fb8-a22e-63f620db27bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53df8791-eb7c-463d-a4e4-369a6734699f', 'volume_name': 'volume-53df8791-eb7c-463d-a4e4-369a6734699f', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3faa39f9-0042-460c-a2ea-d8cf12f169fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3faa39f9-0042-460c-a2ea-d8cf12f169fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6214a508-9e5a-4ce2-a383-f20b9275e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:48 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume 53df8791-eb7c-463d-a4e4-369a6734699f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53df8791-eb7c-463d-a4e4-369a6734699f', 'volume_size': 1}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-542451464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53df8791-eb7c-463d-a4e4-369a6734699f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:48Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Creating volume 53df8791-eb7c-463d-a4e4-369a6734699f {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:48 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:48 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=158, name=volume-53df8791-eb7c-463d-a4e4-369a6734699f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f 1073741824" returned: 0 in 0.436s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f" returned: 0 in 0.138s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] <== create_volume: return (648ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6214a508-9e5a-4ce2-a383-f20b9275e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53df8791-eb7c-463d-a4e4-369a6734699f', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f46a52-5cd1-47b6-8384-f4d0f05c9b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:48 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume volume-53df8791-eb7c-463d-a4e4-369a6734699f (53df8791-eb7c-463d-a4e4-369a6734699f): created successfully
Sep 18 14:05:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f46a52-5cd1-47b6-8384-f4d0f05c9b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (cfe43064-ce2d-4347-9019-3701ac1bf652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:49 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-4efe2e7c-e139-44c3-9fb1-43c624151512 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created volume successfully.
Sep 18 14:05:49 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:49 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Creating offline snapshot c06188f9-7ed8-45bb-b975-06d04650ee33 of volume 3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 14:05:49 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a33e61a-5a74-4933-af11-1c3dca384a55]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5" returned: 0 in 0.453s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:49 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:49 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=159, name=volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 1G" returned: 0 in 0.284s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] CMD "qemu-img rebase -u -b volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33" returned: 0 in 0.204s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33" returned: 0 in 0.391s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:50 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33" returned: 0 in 0.195s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.info" returned: 0 in 0.150s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.info" returned: 0 in 0.127s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.528s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Creating offline snapshot 08d9b992-33aa-4be2-af26-ee1211f8f634 of volume 53df8791-eb7c-463d-a4e4-369a6734699f {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a41dd0c-0a3d-40b9-b578-c52c3ba85917]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:51 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ffec5541-cce2-45e1-be36-ad18520e0abf tempest-SnapshotDependencyTests-403987766 None] Create snapshot completed successfully
Sep 18 14:05:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f" returned: 0 in 0.534s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:52 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=161, name=volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 1G" returned: 0 in 0.315s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): qemu-img rebase -u -b volume-53df8791-eb7c-463d-a4e4-369a6734699f -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "qemu-img rebase -u -b volume-53df8791-eb7c-463d-a4e4-369a6734699f -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634" returned: 0 in 0.185s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 14:05:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634" returned: 0 in 0.134s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 14:05:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634" returned: 0 in 0.424s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:53 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:53 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Flow 'volume_create_manager' (653877ed-bd76-4e06-906a-c012017e0f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:53 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0733c5-4be8-4801-aeff-5a4d9c6b9db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.info" returned: 0 in 0.508s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0733c5-4be8-4801-aeff-5a4d9c6b9db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c3b32b-31d1-456a-ad00-cf1eda230ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f836fb4242ad4cf08676044de51b4e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:53Z,use_quota=True,user_id='84efddb5577547738997ffdb04bdf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f41182e-378f-424a-9ca9-f23f98af5441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f41182e-378f-424a-9ca9-f23f98af5441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbc24c3-197a-4b54-a57b-11ed98b83976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.image.glance [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Creating Keystone auth plugin from conf {{(pid=82799) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 14:05:54 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.info" returned: 0 in 0.287s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.029s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Flow 'volume_create_manager' (8a9d076c-77c8-4737-a0b3-aebddeb851d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303e4fa5-c96f-4887-a1df-ca4e54f442aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303e4fa5-c96f-4887-a1df-ca4e54f442aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a66e7f-c3ca-418d-b32a-b716d1f32f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9960afac0e483f90262767cabee4f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c06188f9-7ed8-45bb-b975-06d04650ee33,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:53Z,use_quota=True,user_id='4cced1e8b3674cd58bd1fb2b988aec0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35987527-d95c-4a2f-aa24-5946c1cdef2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35987527-d95c-4a2f-aa24-5946c1cdef2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be82830-05db-49de-80a3-03bbaaf67ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be82830-05db-49de-80a3-03bbaaf67ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51a66e7f-c3ca-418d-b32a-b716d1f32f67', 'volume_name': 'volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67', 'volume_size': 1, 'snapshot_id': 'c06188f9-7ed8-45bb-b975-06d04650ee33'}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4896c280-7180-4780-ad34-5f17ae40adfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4896c280-7180-4780-ad34-5f17ae40adfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55683bd-b26d-4636-9039-6fcb2b696764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:54 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Volume 51a66e7f-c3ca-418d-b32a-b716d1f32f67: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67', 'volume_size': 1, 'snapshot_id': 'c06188f9-7ed8-45bb-b975-06d04650ee33'}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "cinder-quobyte-c06188f9-7ed8-45bb-b975-06d04650ee33-51a66e7f-c3ca-418d-b32a-b716d1f32f67" by "_create_volume_from_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-6fc8bd3e-76fa-4568-9939-51c853f29adc tempest-CreateVolumesFromSnapshotTest-2063093427 None] Create snapshot completed successfully
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-c06188f9-7ed8-45bb-b975-06d04650ee33-51a66e7f-c3ca-418d-b32a-b716d1f32f67" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Creating volume 51a66e7f-c3ca-418d-b32a-b716d1f32f67 from snapshot c06188f9-7ed8-45bb-b975-06d04650ee33 {{(pid=82799) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "cinder-quobyte-51a66e7f-c3ca-418d-b32a-b716d1f32f67" by "_copy_volume_from_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-51a66e7f-c3ca-418d-b32a-b716d1f32f67" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] snapshot: c06188f9-7ed8-45bb-b975-06d04650ee33, volume: 51a66e7f-c3ca-418d-b32a-b716d1f32f67,  {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db5c377-66d3-47d0-9add-547494dbf3d6]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbc24c3-197a-4b54-a57b-11ed98b83976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8c3b32b-31d1-456a-ad00-cf1eda230ee4', 'volume_name': 'volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4', 'volume_size': 1, 'image_id': 'd8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34bf2b941404632c389febbf84bbc160', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f836fb4242ad4cf08676044de51b4e08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34d88f00f4af91269f389eb7e3dfc6c2efab6141d1374c222c8f3674e52fff6902fa11267888a3a70b3258899b6db24860b0b06099a305064f0023c79068302f', 'id': 'd8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'created_at': datetime.datetime(2025, 9, 18, 12, 5, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 12, 5, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8314ebd-2df9-4eb7-a4ef-89895cfb3530/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c1cd420>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50a0138-3a8b-4c3f-b48d-1d7f561de9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50a0138-3a8b-4c3f-b48d-1d7f561de9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133b4a5d-8912-4867-b002-83233f81727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:55 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Volume a8c3b32b-31d1-456a-ad00-cf1eda230ee4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4', 'volume_size': 1, 'image_id': 'd8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34bf2b941404632c389febbf84bbc160', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f836fb4242ad4cf08676044de51b4e08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34d88f00f4af91269f389eb7e3dfc6c2efab6141d1374c222c8f3674e52fff6902fa11267888a3a70b3258899b6db24860b0b06099a305064f0023c79068302f', 'id': 'd8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'created_at': datetime.datetime(2025, 9, 18, 12, 5, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 12, 5, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8314ebd-2df9-4eb7-a4ef-89895cfb3530/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c1cd420>}
Sep 18 14:05:55 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Cloning a8c3b32b-31d1-456a-ad00-cf1eda230ee4 from image d8314ebd-2df9-4eb7-a4ef-89895cfb3530  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'metadata': {}}]). {{(pid=82799) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 14:05:56 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Image download 0.00 MB at 0.00 MB/s
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33" returned: 0 in 0.924s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Creating direct copy from snapshot {{(pid=82799) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bbc883-9d8a-4324-ba99-238177435afa]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:56 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (0940483d-2dfd-4499-b7de-cffa7a9bfcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a602ec8-124a-40ef-be60-40f7b2efa896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a602ec8-124a-40ef-be60-40f7b2efa896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-980726910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:56Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97185e32-6732-43c4-8644-d9e5f5f6c2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97185e32-6732-43c4-8644-d9e5f5f6c2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1885aaf-c43b-4d85-aca6-6036b1710bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1885aaf-c43b-4d85-aca6-6036b1710bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa', 'volume_name': 'volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c8e0fe-fdde-4ca6-83aa-c5465156b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c8e0fe-fdde-4ca6-83aa-c5465156b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae81f81c-d3ce-4de7-bc7c-7c277e895f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:56 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa', 'volume_size': 1}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f0efc3-3c47-4a62-a003-d06f5b4c9257]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:05:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (69a64e4e-1599-4e83-aacf-c667f23884f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:57 devstack sudo[101895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5b6b64-f18a-4dc7-aa4e-8137887fb596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:57 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5b6b64-f18a-4dc7-aa4e-8137887fb596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-902980089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ee1cb9-9396-4d79-a706-343c501e6f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:56Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563f5f2f-24bd-4824-9e0a-f78aaf61bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563f5f2f-24bd-4824-9e0a-f78aaf61bd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4762412-dca7-465e-9d54-c569fe79fff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4762412-dca7-465e-9d54-c569fe79fff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ee1cb9-9396-4d79-a706-343c501e6f70', 'volume_name': 'volume-c6ee1cb9-9396-4d79-a706-343c501e6f70', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7f898d-b480-4376-a647-bd60f6080052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7f898d-b480-4376-a647-bd60f6080052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ea5b94-c2ee-414f-80c4-17d35514b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:57 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume c6ee1cb9-9396-4d79-a706-343c501e6f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ee1cb9-9396-4d79-a706-343c501e6f70', 'volume_size': 1}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5" returned: 0 in 1.754s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG cinder.utils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67 not found in is_blk_device check {{(pid=82799) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 14:05:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:05:58 devstack quobyte-client[82822]: System call of process 101899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:05:58 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=163, name=volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:05:58 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:58 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:05:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (c2ad2c97-4594-41d2-a5f6-f2cf67588790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:05:58 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3667c1bb-d3cf-46f3-852c-de8451bcff03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:05:59 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:05:59 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (ee62b5ee-e36c-4d77-88e7-b36cce0fd36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0366094a-5748-4c1f-a99a-cc7177a62c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0366094a-5748-4c1f-a99a-cc7177a62c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2113817516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:57Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52640c5-3369-447c-a94f-43a7e5b2ecb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52640c5-3369-447c-a94f-43a7e5b2ecb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688b94cc-e8fa-45eb-8e3c-2153e365f2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688b94cc-e8fa-45eb-8e3c-2153e365f2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02', 'volume_name': 'volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5046c922-ec6d-480e-83e4-f1eb565ba5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5046c922-ec6d-480e-83e4-f1eb565ba5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6f31dc-4594-4f88-aabc-efddae22fb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:00 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02', 'volume_size': 1}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:00 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3667c1bb-d3cf-46f3-852c-de8451bcff03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1355673138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e065c35c-758f-43f5-8dc0-dbb7f557fe84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:58Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb56856-3da7-464a-a98c-3bbd8dc1530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb56856-3da7-464a-a98c-3bbd8dc1530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5da9ec5-9beb-4828-ab46-26598ed79e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5da9ec5-9beb-4828-ab46-26598ed79e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e065c35c-758f-43f5-8dc0-dbb7f557fe84', 'volume_name': 'volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c443fa-3e83-40e2-8404-7017d5768c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c443fa-3e83-40e2-8404-7017d5768c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc86bd5e-1abe-48e6-bf3f-bad1dc4c77f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:01 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume e065c35c-758f-43f5-8dc0-dbb7f557fe84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84', 'volume_size': 1}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:01 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (2f3a226c-4378-4ec0-a510-1934d4657746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489ee190-79c4-46ac-9679-1d50627042ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489ee190-79c4-46ac-9679-1d50627042ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-149992696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329c13af-7876-45b8-b934-46e1ba466758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:58Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb53b0a-81eb-4f46-9a99-61dc29f855a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb53b0a-81eb-4f46-9a99-61dc29f855a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbefa2fa-47ce-43c2-986a-582faf335a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbefa2fa-47ce-43c2-986a-582faf335a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329c13af-7876-45b8-b934-46e1ba466758', 'volume_name': 'volume-329c13af-7876-45b8-b934-46e1ba466758', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b5d4a-30a3-40fa-9a80-eb7d1cefcd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b5d4a-30a3-40fa-9a80-eb7d1cefcd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13f736b-37e7-4080-a82d-c1b4bf07cf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:01 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume 329c13af-7876-45b8-b934-46e1ba466758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329c13af-7876-45b8-b934-46e1ba466758', 'volume_size': 1}
Sep 18 14:06:01 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:03 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root
Sep 18 14:06:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD" returned: 0 in 6.287s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:03 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:04 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD
Sep 18 14:06:04 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 14:06:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67" returned: 0 in 7.793s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:05 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a76232b-4df3-4ed8-b911-cb2f7d861e43]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:05 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5" returned: 0 in 0.947s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:06 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Image conversion details: src /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5, size 1024.00 MB, duration 7.88 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67 {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 14:06:06 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Converted 1024.00 MB image at 130.02 MB/s
Sep 18 14:06:06 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67 is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 14:06:06 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67" returned: 0 in 0.171s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-51a66e7f-c3ca-418d-b32a-b716d1f32f67" released by "_copy_volume_from_snapshot" :: held 12.181s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-c06188f9-7ed8-45bb-b975-06d04650ee33-51a66e7f-c3ca-418d-b32a-b716d1f32f67" released by "_create_volume_from_snapshot" :: held 12.255s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.291s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.581s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-980726910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:56Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Creating volume fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:06:07 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=120,cinder:SELECT=82,cinder:DELETE=14,cinder:INSERT=25 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:06:07 devstack quobyte-client[82822]: System call of process 101961 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:07 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=164, name=volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:07 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD" returned: 1 in 4.785s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:07 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=78,cinder:UPDATE=121,cinder:DELETE=12,cinder:INSERT=19 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Temporary image d8314ebd-2df9-4eb7-a4ef-89895cfb3530 is fetched for user 84efddb5577547738997ffdb04bdf793. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55683bd-b26d-4636-9039-6fcb2b696764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67', 'volume_size': 1, 'snapshot_id': 'c06188f9-7ed8-45bb-b975-06d04650ee33'}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06734328-f85e-4d0c-aa48-26b76c9bad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa 1073741824" returned: 0 in 0.680s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:08 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Volume volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67 (51a66e7f-c3ca-418d-b32a-b716d1f32f67): created successfully
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06734328-f85e-4d0c-aa48-26b76c9bad82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Flow 'volume_create_manager' (8a9d076c-77c8-4737-a0b3-aebddeb851d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa" returned: 0 in 0.441s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] <== create_volume: return (1161ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.869s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-902980089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ee1cb9-9396-4d79-a706-343c501e6f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:56Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Creating volume c6ee1cb9-9396-4d79-a706-343c501e6f70 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:06:08 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:06:08 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c6ee1cb9-9396-4d79-a706-343c501e6f70 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:08 devstack quobyte-client[82822]: System call of process 101965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:08 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=165, name=volume-c6ee1cb9-9396-4d79-a706-343c501e6f70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae81f81c-d3ce-4de7-bc7c-7c277e895f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a146e2ef-62c0-4e01-8fe6-d017b247f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "cinder-c06188f9-7ed8-45bb-b975-06d04650ee33-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a251f5-3644-4e27-84f0-f1e8f350a63f]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:09 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-282c9d1e-89a6-4deb-bdce-6d0128eafe7f tempest-SnapshotDependencyTests-403987766 None] Created volume successfully.
Sep 18 14:06:09 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa (fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa): created successfully
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a146e2ef-62c0-4e01-8fe6-d017b247f35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (0940483d-2dfd-4499-b7de-cffa7a9bfcc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c6ee1cb9-9396-4d79-a706-343c501e6f70 1073741824" returned: 0 in 1.052s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c6ee1cb9-9396-4d79-a706-343c501e6f70 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:09 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD
Sep 18 14:06:09 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 14:06:09 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-c06188f9-7ed8-45bb-b975-06d04650ee33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.683s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:10 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "cinder-quobyte-3d2003a4-c201-4bda-8eff-aec57b31f5c5" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:10 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-805ee2c5-bfe5-4acb-8e5e-aede821b4fe6 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created volume successfully.
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c6ee1cb9-9396-4d79-a706-343c501e6f70" returned: 0 in 0.467s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-3d2003a4-c201-4bda-8eff-aec57b31f5c5" acquired by "delete_snapshot" :: waited 0.240s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "cinder-quobyte-c06188f9-7ed8-45bb-b975-06d04650ee33" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] <== create_volume: return (1571ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.652s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2113817516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:57Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Creating volume fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:06:10 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:10 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=166, name=volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ea5b94-c2ee-414f-80c4-17d35514b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ee1cb9-9396-4d79-a706-343c501e6f70', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4e63a4-388c-43ed-90a7-d9114b03f358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-c06188f9-7ed8-45bb-b975-06d04650ee33" acquired by "_delete_snapshot" :: waited 0.634s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Deleting offline snapshot c06188f9-7ed8-45bb-b975-06d04650ee33 of volume 3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] snapshot_file for this snap is: volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a6eb4c-2398-40f5-8670-1c48594a3b94]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:10 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:11 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume volume-c6ee1cb9-9396-4d79-a706-343c501e6f70 (c6ee1cb9-9396-4d79-a706-343c501e6f70): created successfully
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4e63a4-388c-43ed-90a7-d9114b03f358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (69a64e4e-1599-4e83-aacf-c667f23884f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02 1073741824" returned: 0 in 1.070s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:11 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-46854ebc-114f-42ef-ae17-85eef9eb495a tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created volume successfully.
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02" returned: 0 in 0.384s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] <== create_volume: return (1513ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.599s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1355673138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e065c35c-758f-43f5-8dc0-dbb7f557fe84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:58Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Creating volume e065c35c-758f-43f5-8dc0-dbb7f557fe84 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:06:11 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:06:11 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:12 devstack quobyte-client[82822]: System call of process 101979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:12 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=167, name=volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6f31dc-4594-4f88-aabc-efddae22fb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed41e4d-69ee-4aea-8d60-63a6bd03ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33" returned: 0 in 1.645s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 14:06:12 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02 (fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02): created successfully
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed41e4d-69ee-4aea-8d60-63a6bd03ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (ee62b5ee-e36c-4d77-88e7-b36cce0fd36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e6987c-bb8d-4de3-8aba-87f16cbc4a57]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84 1073741824" returned: 0 in 0.855s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:12 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:12 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Sep 18 14:06:13 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-842c8626-21a2-4e16-82fa-c8f4447a4c9e tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created volume successfully.
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD" returned: 0 in 4.098s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84" returned: 0 in 0.653s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] <== create_volume: return (1681ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.940s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-149992696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329c13af-7876-45b8-b934-46e1ba466758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4fb3ee9564439afe53c2f5459d013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:58Z,use_quota=True,user_id='36186da828044d28a20abb1ed33fa0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Creating volume 329c13af-7876-45b8-b934-46e1ba466758 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:06:13 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:06:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-329c13af-7876-45b8-b934-46e1ba466758 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:13 devstack quobyte-client[82822]: System call of process 101990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:14 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=168, name=volume-329c13af-7876-45b8-b934-46e1ba466758, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5" returned: 0 in 1.298s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:14 devstack sudo[101989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD
Sep 18 14:06:14 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 14:06:14 devstack quobyte-client[82822]: System call of process 101993 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 1.055s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc86bd5e-1abe-48e6-bf3f-bad1dc4c77f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93dd162-bec9-47f7-be4c-5f67407f9cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33" returned: 0 in 0.609s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-329c13af-7876-45b8-b934-46e1ba466758 1073741824" returned: 0 in 0.854s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:14 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-329c13af-7876-45b8-b934-46e1ba466758 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:15 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84 (e065c35c-758f-43f5-8dc0-dbb7f557fe84): created successfully
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93dd162-bec9-47f7-be4c-5f67407f9cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (c2ad2c97-4594-41d2-a5f6-f2cf67588790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5.c06188f9-7ed8-45bb-b975-06d04650ee33" returned: 0 in 0.575s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-329c13af-7876-45b8-b934-46e1ba466758" returned: 0 in 0.555s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] <== create_volume: return (1530ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-c06188f9-7ed8-45bb-b975-06d04650ee33" released by "_delete_snapshot" :: held 4.480s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-434e5c9d-c44d-4fdc-a6e9-921662709d4c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created volume successfully.
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-3d2003a4-c201-4bda-8eff-aec57b31f5c5" released by "delete_snapshot" :: held 5.156s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13f736b-37e7-4080-a82d-c1b4bf07cf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329c13af-7876-45b8-b934-46e1ba466758', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0fbdeb-f3b3-448a-8dbf-5d924b075d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:15 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume volume-329c13af-7876-45b8-b934-46e1ba466758 (329c13af-7876-45b8-b934-46e1ba466758): created successfully
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0fbdeb-f3b3-448a-8dbf-5d924b075d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Flow 'volume_create_manager' (2f3a226c-4378-4ec0-a510-1934d4657746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-d75cc904-5fc4-4f7f-9a47-d014c08275f4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created volume successfully.
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Created reservations ['1e0a612f-3ebe-4b95-9953-ef7fa9a8952a', '5a12f37f-d1b7-489f-84ed-55ac3f483d8c', '1b1e7d3b-27e3-483c-b233-4142facffbe2', '20637ce3-4b51-4759-b663-622381840869'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:15 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Delete snapshot completed successfully.
Sep 18 14:06:15 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8ea4bdd2-8229-4d87-8424-71e9f92e7b41 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-c06188f9-7ed8-45bb-b975-06d04650ee33-delete_snapshot" released by "delete_snapshot" :: held 5.965s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:16 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD" returned: 1 in 3.091s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c3b32b-31d1-456a-ad00-cf1eda230ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f836fb4242ad4cf08676044de51b4e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:05:53Z,use_quota=True,user_id='84efddb5577547738997ffdb04bdf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Creating volume a8c3b32b-31d1-456a-ad00-cf1eda230ee4 {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:06:16 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:16 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=169, name=volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:16 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-329c13af-7876-45b8-b934-46e1ba466758-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "cinder-3d2003a4-c201-4bda-8eff-aec57b31f5c5-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 1073741824" returned: 0 in 0.546s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-329c13af-7876-45b8-b934-46e1ba466758-delete_volume" acquired by "delete_volume" :: waited 0.398s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-3d2003a4-c201-4bda-8eff-aec57b31f5c5-delete_volume" acquired by "delete_volume" :: waited 0.469s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" returned: 0 in 0.386s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] <== create_volume: return (972ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:17 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-quobyte-329c13af-7876-45b8-b934-46e1ba466758" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-329c13af-7876-45b8-b934-46e1ba466758" acquired by "delete_volume" :: waited 0.028s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Attempting download of d8314ebd-2df9-4eb7-a4ef-89895cfb3530 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'metadata': {}}])) to volume a8c3b32b-31d1-456a-ad00-cf1eda230ee4. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29720bb-5871-4450-83c0-afe21ff21a35]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:17 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-329c13af-7876-45b8-b934-46e1ba466758 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:18 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "cinder-quobyte-3d2003a4-c201-4bda-8eff-aec57b31f5c5" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38c06f7-d2c6-48a6-9682-378d95003467]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_evm5e2tp {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-3d2003a4-c201-4bda-8eff-aec57b31f5c5" acquired by "delete_volume" :: waited 0.310s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[07131309-0cd3-41b6-b67f-169302e1dfa5]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-329c13af-7876-45b8-b934-46e1ba466758" returned: 0 in 0.867s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-329c13af-7876-45b8-b934-46e1ba466758 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_evm5e2tp" returned: 0 in 0.603s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_evm5e2tp {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:18 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-329c13af-7876-45b8-b934-46e1ba466758" returned: 0 in 0.306s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:19 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-329c13af-7876-45b8-b934-46e1ba466758" released by "delete_volume" :: held 1.418s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:19 devstack quobyte-client[82822]: System call of process 102010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5" returned: 0 in 0.825s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-3d2003a4-c201-4bda-8eff-aec57b31f5c5" returned: 0 in 0.265s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_evm5e2tp" returned: 1 in 0.851s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_evm5e2tp' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 14:06:19 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50a2e98-893c-461a-8a2f-23e1c35f533a]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:19 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-3d2003a4-c201-4bda-8eff-aec57b31f5c5" released by "delete_volume" :: held 1.300s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:19 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created reservations ['79686755-e610-4698-9a67-135b40475560', 'dbe50ae7-d0b3-4536-84ba-98ad9284deb6', 'c02dad9c-f05e-47cb-81e4-cac04fa2e384', '8936b9dd-466d-4299-89fe-b07a31a222b5'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Created reservations ['23e02b9d-60a8-4c3b-94d3-ba076d7730ce', '15da68e9-a870-4183-89b2-71336325baee', 'b3ae29cb-f618-4e5d-b9bd-aaa76a5c9077', 'cedf3f58-6d71-4340-9a03-16a3c6838088'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD" returned: 0 in 0.575s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.297s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:20 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:21 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Deleted volume successfully.
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD" returned: 1 in 0.765s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] d8314ebd-2df9-4eb7-a4ef-89895cfb3530 was raw, converting to raw {{(pid=82799) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:21 devstack quobyte-client[82822]: System call of process 102024 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:21 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=169, name=volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-e065c35c-758f-43f5-8dc0-dbb7f557fe84-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a011101-3d31-469b-9808-6993c6b55f5c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-329c13af-7876-45b8-b934-46e1ba466758-delete_volume" released by "delete_volume" :: held 4.223s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" returned: 0 in 0.562s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8314ebd-2df9-4eb7-a4ef-89895cfb3530_jzhh7gx4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 {{(pid=82799) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 14:06:21 devstack cinder-volume[82799]: INFO cinder.image.image_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Converted 0.00 MB image at 0.00 MB/s
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:21 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "cinder-51a66e7f-c3ca-418d-b32a-b716d1f32f67-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-e065c35c-758f-43f5-8dc0-dbb7f557fe84-delete_volume" acquired by "delete_volume" :: waited 0.591s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-51a66e7f-c3ca-418d-b32a-b716d1f32f67-delete_volume" acquired by "delete_volume" :: waited 0.270s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.631s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 1G" returned: 0 in 0.464s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:22 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Deleted volume successfully.
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc42866f-5a89-43fd-b285-347544811eb9]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-cc43df3e-dea0-4aa4-888a-4a9d81f49c5f tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-3d2003a4-c201-4bda-8eff-aec57b31f5c5-delete_volume" released by "delete_volume" :: held 5.092s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:22 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-quobyte-e065c35c-758f-43f5-8dc0-dbb7f557fe84" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:22 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "cinder-quobyte-51a66e7f-c3ca-418d-b32a-b716d1f32f67" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-e065c35c-758f-43f5-8dc0-dbb7f557fe84" acquired by "delete_volume" :: waited 0.066s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-51a66e7f-c3ca-418d-b32a-b716d1f32f67" acquired by "delete_volume" :: waited 0.059s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bec84e-834e-41ac-87b1-e36408b75cb6]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:22 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:23 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[001a06e2-33ba-4bde-9ad9-e703b378215d]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" returned: 0 in 0.733s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84" returned: 0 in 0.550s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:23 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-e065c35c-758f-43f5-8dc0-dbb7f557fe84" returned: 0 in 0.195s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:23 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-e065c35c-758f-43f5-8dc0-dbb7f557fe84" released by "delete_volume" :: held 0.986s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67" returned: 0 in 0.975s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" returned: 1 in 1.110s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Downloaded image d8314ebd-2df9-4eb7-a4ef-89895cfb3530 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'metadata': {}}])) to volume a8c3b32b-31d1-456a-ad00-cf1eda230ee4 successfully. {{(pid=82799) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.image.image_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Temporary image d8314ebd-2df9-4eb7-a4ef-89895cfb3530 for user 84efddb5577547738997ffdb04bdf793 is deleted. {{(pid=82799) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.volume.volume_utils [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Marking volume a8c3b32b-31d1-456a-ad00-cf1eda230ee4 as bootable. {{(pid=82799) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-51a66e7f-c3ca-418d-b32a-b716d1f32f67" returned: 0 in 0.369s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Copying metadata from image d8314ebd-2df9-4eb7-a4ef-89895cfb3530 to a8c3b32b-31d1-456a-ad00-cf1eda230ee4. {{(pid=82799) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Creating volume glance metadata for volume a8c3b32b-31d1-456a-ad00-cf1eda230ee4 backed by image d8314ebd-2df9-4eb7-a4ef-89895cfb3530 with: {'image_id': 'd8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '34bf2b941404632c389febbf84bbc160', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82799) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-quobyte-51a66e7f-c3ca-418d-b32a-b716d1f32f67" released by "delete_volume" :: held 1.665s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133b4a5d-8912-4867-b002-83233f81727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4', 'volume_size': 1, 'image_id': 'd8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34bf2b941404632c389febbf84bbc160', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f836fb4242ad4cf08676044de51b4e08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34d88f00f4af91269f389eb7e3dfc6c2efab6141d1374c222c8f3674e52fff6902fa11267888a3a70b3258899b6db24860b0b06099a305064f0023c79068302f', 'id': 'd8314ebd-2df9-4eb7-a4ef-89895cfb3530', 'created_at': datetime.datetime(2025, 9, 18, 12, 5, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 12, 5, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8314ebd-2df9-4eb7-a4ef-89895cfb3530/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1e8c1cd420>}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209f1dcd-234c-4bb3-b594-702adf97b3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:24 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Volume volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 (a8c3b32b-31d1-456a-ad00-cf1eda230ee4): created successfully
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209f1dcd-234c-4bb3-b594-702adf97b3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Flow 'volume_create_manager' (653877ed-bd76-4e06-906a-c012017e0f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created reservations ['3ab06d8c-16fd-49c4-a437-d8c293bc6a38', '21da4ecb-6faf-4a0d-a106-758db575fbb8', '3fab8765-a34d-4335-9634-db781d3c69d9', 'eaa93227-fce7-448f-b560-473de11e39a8'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Created reservations ['37b7062b-9b86-4dec-8763-551d216778f1', '75d6daea-daa6-4b75-b42a-2cd4850d5674', '8b22335c-efad-4855-8926-7faad185baaf', '2d1e263d-29e2-40d0-8d2a-3cacc5abcaeb'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:24 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ba9bb466-85f9-4987-b2d8-855c83bab7f1 tempest-VolumeImageDependencyTests-926785050 None] Created volume successfully.
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:24 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Acquiring lock "cinder-a8c3b32b-31d1-456a-ad00-cf1eda230ee4-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.790s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02-delete_volume" acquired by "delete_volume" :: waited 0.414s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:25 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Lock "cinder-a8c3b32b-31d1-456a-ad00-cf1eda230ee4-delete_volume" acquired by "delete_volume" :: waited 0.455s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:25 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Deleted volume successfully.
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.498s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:26 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Deleted volume successfully.
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-80f93916-36c3-4923-9adc-b582f7b53353 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-e065c35c-758f-43f5-8dc0-dbb7f557fe84-delete_volume" released by "delete_volume" :: held 4.001s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:26 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-quobyte-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8e6306e5-5edf-4afa-8a8d-eda8bacf4290 tempest-SnapshotDependencyTests-403987766 None] Lock "cinder-51a66e7f-c3ca-418d-b32a-b716d1f32f67-delete_volume" released by "delete_volume" :: held 4.048s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:26 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Acquiring lock "cinder-quobyte-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02" acquired by "delete_volume" :: waited 0.055s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Lock "cinder-quobyte-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" acquired by "delete_volume" :: waited 0.052s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea0d11c-7653-4a5f-9e30-c890a1ed9c12]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eb26bf-a1de-4a7d-81f1-f6a2bfcccc19]: (4, 'raw') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:26 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02" returned: 0 in 0.669s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02" returned: 0 in 0.140s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" returned: 0 in 0.858s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:27 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02" released by "delete_volume" :: held 1.198s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:27 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created reservations ['a0da4169-c1c1-47b8-85f7-b3750ed584db', '4a9fdfae-775e-4639-8444-220d887654c4', '29717546-6a88-4cce-858f-8ada943343c9', 'cde53860-5658-4692-a5cf-ca4d6ccbaa36'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" returned: 1 in 0.640s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:27 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4' failed. Not Retrying. {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 14:06:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" returned: 0 in 0.286s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:28 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Lock "cinder-quobyte-a8c3b32b-31d1-456a-ad00-cf1eda230ee4" released by "delete_volume" :: held 2.171s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:28 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:28 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-c6ee1cb9-9396-4d79-a706-343c501e6f70-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Created reservations ['3ef52a6c-a4b5-411e-a7d4-db6d764100a8', '1fb07dab-4e8a-4684-8181-abf3faac3ca4', '6cae7bb4-ae93-4916-ab17-633dde353b31', 'ca9d76e3-8dc6-4611-9d3c-c9f25f7f0f96'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.591s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-c6ee1cb9-9396-4d79-a706-343c501e6f70-delete_volume" acquired by "delete_volume" :: waited 0.300s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:29 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Deleted volume successfully.
Sep 18 14:06:29 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-quobyte-c6ee1cb9-9396-4d79-a706-343c501e6f70" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-3ca84031-4a72-4039-b878-bea6d1589796 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-fc2b7d0b-adb3-45cf-a66c-fc966ccdcc02-delete_volume" released by "delete_volume" :: held 3.831s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-c6ee1cb9-9396-4d79-a706-343c501e6f70" acquired by "delete_volume" :: waited 0.037s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb0e11c-f54f-48aa-9e69-5bce2f333702]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:29 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c6ee1cb9-9396-4d79-a706-343c501e6f70 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.269s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:30 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Deleted volume successfully.
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-29e1d02e-208b-43f5-97e2-1f76addfb1bd tempest-VolumeImageDependencyTests-926785050 None] Lock "cinder-a8c3b32b-31d1-456a-ad00-cf1eda230ee4-delete_volume" released by "delete_volume" :: held 4.776s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c6ee1cb9-9396-4d79-a706-343c501e6f70" returned: 0 in 1.100s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:30 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c6ee1cb9-9396-4d79-a706-343c501e6f70 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:31 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-c6ee1cb9-9396-4d79-a706-343c501e6f70" returned: 0 in 0.239s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:31 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-c6ee1cb9-9396-4d79-a706-343c501e6f70" released by "delete_volume" :: held 1.458s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:31 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created reservations ['8bbfa168-681d-4f13-b04e-782bd0d35e7f', '35705201-0357-4409-bd7a-5ed2b7a78245', 'c9834052-104c-49ab-bbb5-c62a926291d0', '2520181c-2ed6-45b4-b718-5a96316c494d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.193s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:32 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Deleted volume successfully.
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-bf469aa7-1dd2-439b-8316-5cab5ee039df tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-c6ee1cb9-9396-4d79-a706-343c501e6f70-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:32 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:33 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-quobyte-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:33 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa" acquired by "delete_volume" :: waited 0.018s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:33 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac82a7-bd8b-40f4-a04f-9e75a7f42387]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa" returned: 0 in 0.561s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:33 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:34 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa" returned: 0 in 0.180s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:34 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa" released by "delete_volume" :: held 1.079s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:34 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created reservations ['e65e3e0c-9eae-4f23-a2af-662600fa003f', '1eab34bc-f7f3-458c-9080-e0d8f41f610b', 'da22e6c9-623f-41b3-be1d-ba68fa6b1e2e', '9185fdee-65b6-4ea3-9bb7-07cfbc28c0f3'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-08d9b992-33aa-4be2-af26-ee1211f8f634-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.347s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:35 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Deleted volume successfully.
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-08d9b992-33aa-4be2-af26-ee1211f8f634-delete_snapshot" acquired by "delete_snapshot" :: waited 0.226s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:35 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-quobyte-53df8791-eb7c-463d-a4e4-369a6734699f" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-53df8791-eb7c-463d-a4e4-369a6734699f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-quobyte-08d9b992-33aa-4be2-af26-ee1211f8f634" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-08d9b992-33aa-4be2-af26-ee1211f8f634" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Deleting offline snapshot 08d9b992-33aa-4be2-af26-ee1211f8f634 of volume 53df8791-eb7c-463d-a4e4-369a6734699f {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] snapshot_file for this snap is: volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[666cc031-500e-4e87-a3e0-b321938db1d9]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:35 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-ce594b69-f7e4-4bb4-a879-db8dee43fcb7 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-fc620b6b-4e3e-4d9f-b8cb-ec4d00327ffa-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634" returned: 0 in 0.533s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:36 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53df8791-eb7c-463d-a4e4-369a6734699f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 14:06:36 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[1514c8dc-b8cc-4f8a-bde8-871bf22257d9]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f" returned: 0 in 0.530s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:36 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:37 devstack quobyte-client[82822]: System call of process 102082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634" returned: 0 in 0.389s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:37 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f.08d9b992-33aa-4be2-af26-ee1211f8f634" returned: 0 in 0.179s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-08d9b992-33aa-4be2-af26-ee1211f8f634" released by "_delete_snapshot" :: held 2.005s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:37 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-53df8791-eb7c-463d-a4e4-369a6734699f" released by "delete_snapshot" :: held 2.050s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:38 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created reservations ['0f6525ba-2a7c-4a63-92e6-e145dd3da0d5', '0f773b13-084e-4b28-b196-7895c9ba97a5', '680c7dbd-8b8a-49c2-bd25-b3fda1c988b5', '7d52a4bc-cee2-415e-be2b-0092f556df4d'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:38 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Delete snapshot completed successfully.
Sep 18 14:06:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-41c53428-c8c3-44f9-9df0-98418427928c tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-08d9b992-33aa-4be2-af26-ee1211f8f634-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-53df8791-eb7c-463d-a4e4-369a6734699f-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-53df8791-eb7c-463d-a4e4-369a6734699f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:38 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "cinder-quobyte-53df8791-eb7c-463d-a4e4-369a6734699f" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:38 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-53df8791-eb7c-463d-a4e4-369a6734699f" acquired by "delete_volume" :: waited 0.015s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:38 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[905446ce-7a73-4822-9bad-65bb307d212a]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:38 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f" returned: 0 in 0.483s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:39 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-53df8791-eb7c-463d-a4e4-369a6734699f" returned: 0 in 0.109s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:39 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-quobyte-53df8791-eb7c-463d-a4e4-369a6734699f" released by "delete_volume" :: held 0.786s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Created reservations ['509d068a-0bc5-45e8-8e17-e8ba18c3037f', 'd254c580-aa30-44e5-a47c-8dd8112293cd', 'cdebac9a-05b7-4843-b5da-369cc4248179', '793f9918-9c63-4671-b8a8-600b4f3712dc'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.117s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:40 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Deleted volume successfully.
Sep 18 14:06:40 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-7a7e9621-e3a9-4c11-a863-e5d574c4e3b4 tempest-CreateVolumesFromSnapshotTest-2063093427 None] Lock "cinder-53df8791-eb7c-463d-a4e4-369a6734699f-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:45 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Flow 'volume_create_manager' (157306e9-7a13-49ea-aa9e-46500ccdda38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3870b00-b679-4aad-8175-4446158aa8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3870b00-b679-4aad-8175-4446158aa8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d61aa06-4244-47d7-8a66-7ea6f233449e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe122120f6134a32b0e0e2860f07f0ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:06:45Z,use_quota=True,user_id='902165d5481547ffa6fd43cde9bc5b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c6a86f-e761-4f7e-9ea8-3908dbd54961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c6a86f-e761-4f7e-9ea8-3908dbd54961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9ee2bc-eea4-4360-9088-eee851424d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9ee2bc-eea4-4360-9088-eee851424d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d61aa06-4244-47d7-8a66-7ea6f233449e', 'volume_name': 'volume-0d61aa06-4244-47d7-8a66-7ea6f233449e', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5bb53b-7b4f-4e3c-a90d-de3c47e3064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5bb53b-7b4f-4e3c-a90d-de3c47e3064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d05794-7f9a-4638-ae23-ba94704cc97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:45 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Volume 0d61aa06-4244-47d7-8a66-7ea6f233449e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d61aa06-4244-47d7-8a66-7ea6f233449e', 'volume_size': 1}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d61aa06-4244-47d7-8a66-7ea6f233449e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe122120f6134a32b0e0e2860f07f0ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:06:45Z,use_quota=True,user_id='902165d5481547ffa6fd43cde9bc5b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Creating volume 0d61aa06-4244-47d7-8a66-7ea6f233449e {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:06:45 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:06:45 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0d61aa06-4244-47d7-8a66-7ea6f233449e 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:45 devstack quobyte-client[82822]: System call of process 102093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:45 devstack quobyte-client[82822]: System call of process 102093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:45 devstack quobyte-client[82822]: System call of process 102093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 14:06:45 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=170, name=volume-0d61aa06-4244-47d7-8a66-7ea6f233449e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0d61aa06-4244-47d7-8a66-7ea6f233449e 1073741824" returned: 0 in 0.358s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0d61aa06-4244-47d7-8a66-7ea6f233449e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0d61aa06-4244-47d7-8a66-7ea6f233449e" returned: 0 in 0.090s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:46 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] <== create_volume: return (516ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:06:46 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.536s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d05794-7f9a-4638-ae23-ba94704cc97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d61aa06-4244-47d7-8a66-7ea6f233449e', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62fca8d-2204-4399-b5a9-f2ad5d66e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:46 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Volume volume-0d61aa06-4244-47d7-8a66-7ea6f233449e (0d61aa06-4244-47d7-8a66-7ea6f233449e): created successfully
Sep 18 14:06:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62fca8d-2204-4399-b5a9-f2ad5d66e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:46 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Flow 'volume_create_manager' (157306e9-7a13-49ea-aa9e-46500ccdda38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:46 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-770450db-9861-4222-8a82-d27f00ca55a5 tempest-CinderUnicodeTest-1959784937 None] Created volume successfully.
Sep 18 14:06:48 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82799) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Flow 'volume_create_manager' (05429c87-4b5f-41c0-9660-c9b7bfd6119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc793823-85d1-447b-978c-71aa47c252ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc793823-85d1-447b-978c-71aa47c252ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:06:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1059769923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b34eeb-febf-47cf-96bd-5b4ff53d704c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe122120f6134a32b0e0e2860f07f0ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:06:48Z,use_quota=True,user_id='902165d5481547ffa6fd43cde9bc5b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243d3d0e-059d-43dd-af2b-774ec0ce4ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243d3d0e-059d-43dd-af2b-774ec0ce4ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1aa2ce7-3d74-4123-9ae9-87af3f8f3e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1aa2ce7-3d74-4123-9ae9-87af3f8f3e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b34eeb-febf-47cf-96bd-5b4ff53d704c', 'volume_name': 'volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4eaf4e6-05aa-4a63-bcbd-b4605d235c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4eaf4e6-05aa-4a63-bcbd-b4605d235c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a462d8-78a4-463e-b26b-03aee5469bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:48 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Volume d1b34eeb-febf-47cf-96bd-5b4ff53d704c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c', 'volume_size': 1}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f1e97193040>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T12:06:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1059769923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b34eeb-febf-47cf-96bd-5b4ff53d704c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe122120f6134a32b0e0e2860f07f0ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T12:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T12:06:48Z,use_quota=True,user_id='902165d5481547ffa6fd43cde9bc5b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cb7bed-628d-4cce-9a75-0d2e2eca5369),volume_type_id=97cb7bed-628d-4cce-9a75-0d2e2eca5369)}" {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Creating volume d1b34eeb-febf-47cf-96bd-5b4ff53d704c {{(pid=82799) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Selected 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101 as target Quobyte volume. {{(pid=82799) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 14:06:48 devstack cinder-volume[82799]: INFO cinder.volume.drivers.remotefs [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] casted to 10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c 1073741824 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:48 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=171, name=volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c 1073741824" returned: 0 in 0.371s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" returned: 0 in 0.095s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] <== create_volume: return (538ms) {'provider_location': '10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'} {{(pid=82799) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 14:06:48 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.551s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a462d8-78a4-463e-b26b-03aee5469bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c', 'volume_size': 1}' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6384363b-3699-48de-8b00-1cf14b92ffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 14:06:49 devstack cinder-volume[82799]: INFO cinder.volume.flows.manager.create_volume [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Volume volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c (d1b34eeb-febf-47cf-96bd-5b4ff53d704c): created successfully
Sep 18 14:06:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6384363b-3699-48de-8b00-1cf14b92ffd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82799) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 14:06:49 devstack cinder-volume[82799]: DEBUG cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Flow 'volume_create_manager' (05429c87-4b5f-41c0-9660-c9b7bfd6119a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82799) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 14:06:49 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-7fd31dc0-892d-4586-b3dc-a30c4571a963 tempest-CinderUnicodeTest-1959784937 None] Created volume successfully.
Sep 18 14:06:50 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:50 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Creating offline snapshot 71d20124-c317-4417-8119-9841a369a20c of volume d1b34eeb-febf-47cf-96bd-5b4ff53d704c {{(pid=82799) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 14:06:50 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b360d540-c107-4c8b-a700-b1b8789bea98]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:50 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" returned: 0 in 0.391s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c 1G {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:51 devstack quobyte-client[82822]: The server volume:df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=df1b1c00-6a24-4e47-9a51-1ec96bb4ffbe, inode=172, name=volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.113), requestorAccessMask=0
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c 1G" returned: 0 in 0.308s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] CMD "qemu-img rebase -u -b volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c -F qcow2 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c" returned: 0 in 0.161s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c" returned: 0 in 0.113s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Setting permissions: /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c -> 1000:1000 {{(pid=82799) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c" returned: 0 in 0.090s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.info" returned: 0 in 0.091s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] File path /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.info is being set with permissions: 660 {{(pid=82799) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 14:06:51 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.info {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.info" returned: 0 in 0.092s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.576s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:52 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-e299a488-99cf-4539-b4a6-7ba5a08da4c1 tempest-CinderUnicodeTest-1959784937 None] Create snapshot completed successfully
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "cinder-71d20124-c317-4417-8119-9841a369a20c-delete_snapshot" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-71d20124-c317-4417-8119-9841a369a20c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:52 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "cinder-quobyte-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" by "delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-quobyte-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "cinder-quobyte-71d20124-c317-4417-8119-9841a369a20c" by "_delete_snapshot" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-quobyte-71d20124-c317-4417-8119-9841a369a20c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Deleting offline snapshot 71d20124-c317-4417-8119-9841a369a20c of volume d1b34eeb-febf-47cf-96bd-5b4ff53d704c {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] snapshot_file for this snap is: volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c {{(pid=82799) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf4267b-2677-48ed-8925-731db8dde5f6]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:52 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c" returned: 0 in 0.431s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:53 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.remotefs [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82799) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 14:06:53 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de9e517-9d25-4855-b685-c87a97cc0a03]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" returned: 0 in 0.427s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:53 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c" returned: 0 in 0.199s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:54 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c.71d20124-c317-4417-8119-9841a369a20c" returned: 0 in 0.090s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-quobyte-71d20124-c317-4417-8119-9841a369a20c" released by "_delete_snapshot" :: held 1.467s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-quobyte-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" released by "delete_snapshot" :: held 1.497s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:54 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Created reservations ['9b673ec7-1d65-492b-a07c-830d0b7cda07', 'ead92826-f3fd-4dbe-8c6d-73bcb7439be8', 'cb98fee7-6e83-4857-969f-a75397cc1694', 'dd1f99f1-9d2a-4f58-ad13-3321cdd36ae8'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:54 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Delete snapshot completed successfully.
Sep 18 14:06:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-8415ee92-a606-41e4-9fc7-7245ac613f85 tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-71d20124-c317-4417-8119-9841a369a20c-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "cinder-d1b34eeb-febf-47cf-96bd-5b4ff53d704c-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:54 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-d1b34eeb-febf-47cf-96bd-5b4ff53d704c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:55 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "cinder-quobyte-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-quobyte-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" acquired by "delete_volume" :: waited 0.013s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:55 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6afb8d0-dbdc-4a6c-94d2-a46d31041417]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" returned: 0 in 0.445s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:55 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" returned: 0 in 0.146s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:55 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-quobyte-d1b34eeb-febf-47cf-96bd-5b4ff53d704c" released by "delete_volume" :: held 0.794s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Created reservations ['305ccf1f-fb5a-4460-94f5-698f87dbcc6d', 'a6ec2033-ba48-4d81-ae8f-ab3d88b69d2f', '23d2f1be-3c3e-49b3-93a6-98719455dc82', 'be1a7d53-a6e1-4500-8a32-e21895883d30'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.166s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:56 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Deleted volume successfully.
Sep 18 14:06:56 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0eac4d87-f6b3-4cd0-aaa2-64f90903dffb tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-d1b34eeb-febf-47cf-96bd-5b4ff53d704c-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "cinder-0d61aa06-4244-47d7-8a66-7ea6f233449e-delete_volume" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-0d61aa06-4244-47d7-8a66-7ea6f233449e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:57 devstack cinder-volume[82799]: WARNING cinder.volume.volume_utils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 14:06:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "cinder-quobyte-0d61aa06-4244-47d7-8a66-7ea6f233449e" by "delete_volume" {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 14:06:57 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-quobyte-0d61aa06-4244-47d7-8a66-7ea6f233449e" acquired by "delete_volume" :: waited 0.018s {{(pid=82799) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 14:06:57 devstack cinder-volume[82799]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef6b8fb-edb1-4293-b483-f3c562ccba8a]: (4, 'qcow2') {{(pid=83112) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 14:06:57 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0d61aa06-4244-47d7-8a66-7ea6f233449e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0d61aa06-4244-47d7-8a66-7ea6f233449e" returned: 0 in 0.507s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0d61aa06-4244-47d7-8a66-7ea6f233449e {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] CMD "rm -f /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25/volume-0d61aa06-4244-47d7-8a66-7ea6f233449e" returned: 0 in 0.093s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-quobyte-0d61aa06-4244-47d7-8a66-7ea6f233449e" released by "delete_volume" :: held 0.756s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG cinder.quota [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Created reservations ['fa90ea88-62fb-46f5-9160-15b321c2144a', 'cbaa1dd5-2d34-4594-acc7-b4e39fcad823', 'd55f35e3-ff68-4fed-a3bc-01d046f27a67', 'dcf64c96-b283-4d94-935a-430567e7a411'] {{(pid=82799) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.095s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:06:58 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:06:58 devstack cinder-volume[82799]: INFO cinder.volume.manager [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Deleted volume successfully.
Sep 18 14:06:59 devstack cinder-volume[82799]: DEBUG cinder.coordination [None req-0c5dcbf1-38fa-44c0-815c-c29bf1e7222c tempest-CinderUnicodeTest-1959784937 None] Lock "cinder-0d61aa06-4244-47d7-8a66-7ea6f233449e-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82799) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 14:07:08 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=128,cinder:SELECT=78,cinder:INSERT=30,cinder:DELETE=11 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:07:09 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=77,cinder:UPDATE=114,cinder:DELETE=10,cinder:INSERT=35 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:07:13 devstack cinder-volume[82799]: DEBUG oslo_service.periodic_task [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82799) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 14:07:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 14:07:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 14:07:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101': None} {{(pid=82799) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 14:07:13 devstack cinder-volume[82799]: DEBUG cinder.volume.drivers.quobyte [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Available shares ['10.10.41.181/cinder-vol-6be5bd33-2695-4db7-838e-371aa2b20101'] {{(pid=82799) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 14:07:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.lockutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82799) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 14:07:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25 {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 14:07:13 devstack cinder-volume[82799]: DEBUG oslo_concurrency.processutils [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/868ebcbf6af016b772b94b7abc97be25" returned: 0 in 0.122s {{(pid=82799) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 14:07:13 devstack cinder-volume[82799]: DEBUG cinder.manager [None req-a8ecb4d4-8550-440c-ae9c-cbe5510763b2 None None] Notifying Schedulers of capabilities ... {{(pid=82799) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 14:07:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:SELECT=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 14:07:27 devstack cinder-volume[82799]: DEBUG dbcounter [-] [82799] Writing DB stats cinder:UPDATE=1 {{(pid=82799) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}